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ABSTRACT 

This report describes the procedures used to collect, 
describe, and evaluate school-based writing in a special pilot 
portfolio study conducted by the National Assessment of Educational 
Progress (NAEP) to explore portfolios as an alternative method of 
assessing students* writing achievement* The report has three main 
purposes: (1) to explore procedures for collecting classroom -based 
writing from students around the country; (2) to develop methods for 
describing and classifying the variety of writing submitted; and (3) 
to create general scoring guides that could be applied across papers 
written in response to a variety of prompts or activities* The report 
is divided into four chapters. Following an introduction, the first 
chapter describes the writing received from the students and 
information from participating teachers about the activities that 
generated the writing. Chapter 2 explains the procedures used to 
evaluate the writing students submitted as well as the results of 
this evaluation* Chapter 3 compares the results of the NAEP 1990 
writing assessment with the analysis of participants 1 school-based 
writing samples and summarizes the lessons learned from the portfolio 
study. Chapter 4 contains a set of sample papers, further 
illustrating how the evaluative guides can be applied and presenting 
a sense of the range and depth of writing received from participating 
students. Appendixes contain information on demographic 
characteristics and on students' performance by process strategies. 
(SR) 
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Introduction 



Purpose 

In recent years, teachers nationwide have been using process approaches to 
writing instruction to help students become effective communicators. Many 
students write major texts over extended periods of time, and in many class- 
rooms, writing instruction encompasses a range of interrelated activities that 
engage students in pre-writing activities, drafting, and revision. 1 As a part of 
this process, student writers often consult with peers, teachers, and parents. 2 
The aim of these methods is to enable students to produce richer, more 
developed pieces of writing. 

However, we face a problem when we try to assess the extent to which these 
efforts are successful. Traditional methods of evaluating students' writing (in 
particular, the timed essay test) are designed to measure a specific facet of 
writing ability — how well students can write on an assigned topic under 
timed conditions. 3 They are not designed to capture the range and depth of 
the writing processes in which students engage during process writing 
instruction programs. 4 

It is possible to emulate aspects of the process approach to writing within 
the context of traditional writing assessment methods. For example, the time 
allocated for writing can be increased, and can even be held over several days 
to allow for peer review and other classroom activities (e.g.. New Brunswick. 
Canada Reading and Language Arts Multi-day Assessment Program). 5 How- 
ever, holding an assessment over several days poses operational difficulties, 
increasing the costs and complexity of assessments. 



1 Janet Emig, The Composing Processes of Twelfth Graders. (Urbana. IL National Council of 
Teachers of English. NCTE Research Report No. 13. ERIC Document No. ED 058205. 1971). 

- Nancy Atwell. "Making the grade." in Understanding Writing: Wags of Observing. Learning, and 
Teaching (2nd edition). Thomas Newkirk and Nancy Atwell, editors. (Portsmouth. NH: 
Heinemann, 1988). 

' Hunter M. Breland. Roberta Camp. Robert J. Jones. Margaret M. Morris, and Donald A. Rock. 

Assessing Writing Skill. (New York: College Entrance Examination Board. 1987). 
' C. K. Lucas. "Toward ecological evaluation. Part 1." The Quarterly, 10 (1). 1-3. 12-17. 1988. 
* New Brunswick Reading and Language Arts Assessment Program. (Ministry of Education, New 

Brunswick. Canada, 1991). 



Another way of establishing stronger connections between process writing 
curriculums and assessment methods is to adapt an instructional tool — 
writing portfolios — for assessment purposes. 6 Recently, schools, districts, 
and states have been exploring ways of using classroom writing portfolios to 
assess students' writing achievements. Using the writing students have pro- 
duced as they engage in process writing programs establishes an immediate 
connection between the assessment and the writing process curriculum. 7 
Recent efforts to adapt writing portfolios for assessment purposes can be 
classified into three types: the classroom portfolio, the combination portfolio, 
and the assessment portfolio. 

The Classroom Portfolio While Classroom Portfolios differ from 
classroom to classroom, they usually share several key characteristics. During 
the school year, as part of their English/language arts ciasswork, students 
collect their written work in folders. At specific points in the term, they revie*" 
their work and create a portfolio by engaging in a process of reflection, selec- 
tion, and description. (e.g.. New York City Portfolio Project, ARTS Propel).* 

The reflection and selection stages are guided by a set of criteria devel- 
oped by teachers and/or students, based on the writing curriculum they are 
following. 9 These criteria often focus on the depth of student writing (writing 
that demonstrates the use of process strategies and writing that shows growth 
over time) and on the breadth of student vv. 'ting (writing that illustrates the 
range of activities in which students have engaged). 

Often the students determine how many pieces to include in their port- 
folios, with a minimum of three being common practice. A central element 01 
these portfolios is the letters or statements students write explaining their 
selections and how their choices meet th« selection criteria. This process of 
• eviewing and evaluating one's own writing and then articulating one's deci- 
sions is considered central to the portfolio experience because it fosters 
students' development as writers. 10 The classroom teachers assist students 
throughout this process and also evaluate the portfolios. Sometimes other 



* S. Murphy and M. A. Smith. "Talking about portfolios." The Quarterly, 12 (2). 1990. 

7 D. Calieher. "Assessment in context: Toward a national writing project model." The Quarterly. 9. 
(3). 5-7. 1987. 

Robert J. Tierney, Mark A. Carter, and Laura E. Desai. Portfolio Assessment in the Reading- 
Writing Classroom. (Norwood. MA: Christopher-Gordon Publishers. Inc.. 1991). 

* Roberta Camp. "Thinking together about portfolios." The Quarterly, 12, (2), 8-14. 27. 1990. 

Mary Fowles and Claudia Gentile. Evaluation Report of CUNY Lehman s Writing Across the 
Curriculum Program, i Princeton. NJ: Educational Testing Service. 1989). 

' Denny P. Wolf. "Opening up assessment." Educational Leadership, 45, (4). 24-29. December. 
1987/January, 1988. 

10 E. Winner and E. Rosenblatt. "Tracking the effects of the portfolio process: What changes and 
when?" Portfolio, 1 (5). 21-26. 1989. 



students, friends, and family read and comment on students' portfolios. 11 
Students may collect portfolios for part of the year, the whole year, or over 
their whole academic careers, for one class or all classes. 

The Combination Portfolio The second type of portfolio assessment 
system uses a combination of approaches to collect writing from students 
(e.g., Vermont Portfolio Project). 12 In addition to asking students to assemble 
a portfolio from the work they have collected for their classes, students are 
asked to select a "best piece" and to include in their letter describing their 
portfolio an explanation of what makes this their best effort. Students may 
also be asked to complete a writing activity common to all students in a 
particular class or group. These three components — portfolio, best piece, and 
common piece — are then evaluated individually by one or more teachers and 
evaluative information is presented on each component, resulting in a profile 
of an individual student's writing achi vements. Summary statements to 
students about their entire portfolios are also made by their classroom 
teacher, other teachers, and/or other students. 

The Assessment Portfolio The third type of portfolio assessment 
system involves administering several common writing activities to students 
(e.g., Rhode Island Portfolio Project). 1 1 Committees of teachers design a series 
of multi-day writing activities that reflect their writing curriculum. On the 
same days, using the same administration procedures, the teachers have their 
students engage in these activities. They collect the students* work in folders 
and have the students review their work and write letters explaining which 
activity yielded the best writing and from which they learned the most. A 
committee of teachers then meets to score tne students' responses to each 
activity. The result is a profile of each student's achievements relative to the 
common tasks. This type of portfolio differs from traditional essay assessments 
in that the activities are designed to match a specific school's or state's cur- 
riculum and the students' work is accomplished as part of their regular 
classroom activities rather than under standardized assessment conditions. 

The 1990 XAKP Pilot Portfolio Study In keeping with these new 
developments, the National Assessment of Educational Progress (NAEP) has 
begun exploring alternative methods of assessing students' writing achieve- 
ments _ methods that focus on the writing students regularly produce as 
part of their classroom activities. NAEP conducted a pilot portfolio study in 



11 J. Flood and D. Lapp. "Reporting reading progress; A comparison portfolio for parents." The 
Reading Teacher. 42. (7). 508-514. 1989. 

12 R. P. Mills. "Portfolios capture rich array of student performance." The School Administrator. 8- 
11. 1989. 

" Mary Fowles and Claudia Gentile. Validity Study of the 1988 Rhode Island Third-Grade Writing 
.Assessment. (Princeton. NJ: Educational Testing Service. 1989). » 



1990 in order to explore the feasibility of conducting large-scale assessments 
using school-based writing. The main purposes of this pilot study were: (1) to 
explore procedures for collecting classroom-based writing from students 
around the country; (2) to develop methods for describing and classifying the 
variety of writing submitted; and (3) to create general scoring guides that 
could be applied across papers written in response to a variety of prompts or 
activities. 

To this end, a nationally representative subgroup of the fourth and eighth 
graders who participated in NAEP's 1990 writing trend assessment was asked 
to work with their teachers and submit one piece of writing that they consid- 
ered to be a sample of their best writing efforts. The goal was to create a 
"Nation's Portfolio" — a compilation of the best writing produced by fourth 
and eighth graders itvclassrooms across the country. 

NAEP analyzed and summarized these samples of writing along with teach- 
ers' descriptions of the assignments that produced them. In addition, NAEP 
compared students' school-based writings to their responses on the 1990 
NAEP writing assessment to examine relationships between these two modes 
of assessment. This report describes the procedures used to collect, describe, 
and evaluate the school-based writing in this special pilot study. 

The 1990 writing assessment was a trend assessment — prompts that had 
been developed for the 1984 assessment, and readministered in 1988, were 
also given in 1990 in order to measure changes in students' writing achieve- 
ments across the six-year period. In 1992, NAEP will continue the writing 
trend assessment, as well as conduct a new writing assessment comprised of 
imormative, narrative, and persuasive writing prompts developed specifically 
for the 1992 assessment. While the trend writing assessment has not changed 
since 1984, the new 1992 writing assessment reflects recent developments in 
the field of writing instruction and assessment. For example, the time allo- 
cated for writing has been expanded to 25- and 50-minute periods. Also, a 
planning page has been included after each prompt, to encourage students to 
reflect and plan their responses to the topics. The 1992 assessment will also 
include a revised and expanded version of the 1990 pilot portfolio study and 
participants will be selected from among those students taking the new 
regular writing assessment. 

Collecting Students' Writing 

Thu Participants Approximately 4,000 students who participated in the 
1990 NAEP writing assessment — 2.000 students at grade 4 and another 2,000 
students at grade 8 — were invited to participate in the special portfolio study. 
Based on traditional NAEP sampling procedures, this group would have been a 
nationally representative sample of the nation's fourth and eighth graders. 
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However, only 55 percent (1,110 students) of the fourth graders and 54 per- 
cent (1,101 students) of the eighth graders and/or their teachers accepted this 
invitation. While these response rates provided enough papers to permit an 
analysis of the writing submitted on a pilot basis, as statistical samples they 
were too small to make generalizations about all of the nation s fourth and 
eighth graders' writing performances. 

While the participants did not represent a national sample of students, they 
were from all of the major geographic regions and from various types of 
communities, including rural, suburban, and \r .er city. They represented a 
variety of racial/ethnic backgrounds as well as a balance between males and 
females (see Appendix A for details on the demographic characteristics of the 
participants). 

Compared with the entire group of students who participated in the 1990 
NAEP writing assessment, the participants of this study differed in some 
respects. Slightly higher percentages of the portfolio pilot study participants: 

' were above the modal ages of the sample (ages 9 and 13). 
/ attended schools in advantaged urban communities, reported 

having higher grades, 
.' reported having a greater number of reading materials at home, 

and 

/ received slightly higher scores on the NAEP writing assessment 
tasks. 

When considering the data from this pilot study, it is important to keep in 
mind that the students who participated appear to be somewhat older, higher 
achieving, and more advantaged than the larger population of students 
assessed by NAEP in 1990. 

The Procedures In the spring of 1990, at the time of the NAEP writing 
assessment, the English/language arts teachers of participating students were 
asked to help several of their students choose a sample of their own best 
writing from the work the students had completed so far in the 1989-90 
school year. No more than 10 students from any given class were selected to 
participate. Teachers were asked to encourage their students to choose pieces 
that had involved the ase of writing process strategies (such as revising suc- 
cessive drafts, using reference sources, consulting with others about writing). 
NAEP also asked teachers to attach a description of the activities that gener- 
ated the students' writing and to comment on any process strategies the 
students used to produce their writing. 
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Teachers then submitted their students' writing to NAEP, along with a copy 
or description of the activities that generated the writing and any available 
drafts or prewriting samples. These pieces were used to create two national 
portfolios or collections of students' classroom writing — one containing the 
writings of fourth graders and the other containing the writings of eighth 
graders. 

Unfortunately, due to the complex procedures NAEP employs to select 
students to participate in its assessments, we were unable to inform teachers 
at an early date which of their students would be participating in this study, 
with some teachers receiving only several days' notice. Thus, for the pilot, 
teachers and students did not have much time to review the students' writing 
and select best pieces. Based on this experience, a procedure for giving 
teachers more advance notice of the upcoming portfolio assessment was 
developed for the 1992 NAEP Portfolio Study. It is hoped that, by giving the 
participating teachers in 1992 several months' notice, the 1992 results will 
be representative. 

Outline ol this Report 

This report is divided into four sections. Chapter One describes the writing 
received from the students and information from participating teachers about 
the activities that generated the writing. Chapter Two explains the procedures 
used to evaluate the writing students submitted as well as the results of this 
evaluation. Chapter Three compares the results of the NAEP 1990 writing 
assessment with the analysis of participants' school-based writing samples and 
summarizes the lessons learned from this portfolio study. The last chapter 
contains a set of sample papers, further illustrating how the evaluative guides 
can be applied and presenting a sense of the range and depth of writing we 
received from participating students. 
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Describing the Writing 



The first step in determining the feasibility of analyzing the students' class- 
room-based writing was to see whether NAEP could describe and classify the 
wide diversity of writing submitted by the participants. Considering that no 
more than eight students from any single class were selected to participate in 
this study, most of the papers submitted represented responses to unique 
classroom activities. The corpus of writing submitted might be so diverse that 
every paper would need to be evaluated v ith a unique set of criteria, which 
would make comparing students' classroom-based writing impossible. The 
challenge, then, was to develop descriptive criteria that would yield useful 
information about the types of writing students submitted. Once this was 
accomplished, the next step, moving beyond describing papers to evaluating 
performance, could be addressed. 

Describing the classroom-based writing collected from students across the 
nation yields a profile of the types of writing activities actually occurring in 
our nation's classrooms. Classroom-based writing samples provide us with 
first-hand information about the writing activities in which students are 
engaging, rather than the second-hand information gained from teacher and 
student surveys. This information provides a rich context in which to place 
the results of NAEP's timed writing assessment. For example, although 
persuasive writing is featured prominently in the frameworks which underlie 
the NAEP writing assessments, the small number of persuasive papers submit- 
ted by students in this pilot study indicates that persuasive writing was not 
frequently part of their classroom activities. 

To accomplish the task of describing the writing submitted, a pane! of 
writing experts was assembled. Each member had experience developing 
writing portfolio programs at the school, district, or state level. After reading a 
large sample of the students' pape*s, the panel developed a series of descriptive 
categories to capture the key features of the students' papers. These categories 
focused on: (1) the types of writing submitted; (2) the audience addressed; and 
(3) the evidence of resources used. Also noted were: (4) evidence of process 
and revision strategies used; (5) evidence of computer use; and 16) length of 
texl. A group of trained essay readers then read all of the papers submitted and 
applied these descriptive categories to the papers. The results of this analysis 
are presented below. 
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Types of Writing 

As shown in "fable 1.1, at both grades 4 and 8 the majority of writing submit- 
ted was classified as informative. A large percentage of the papers submitted 
were narratives and very few were persuasive pieces, poems, letters, or re- 
search reports. One percent of the eighth-grade papers were persuasive letters. 
These were classified as persuasives in order to increase the sample of 
persuasive pieces available for analysis. 



Table '1.1: Types of Writing* 



f- <l lif.iti-- 

lypt of wrung, 


Grade 4 


Grade 8 




% 


% 


Informative 


51 


59 


Narrative 


36 


30 


Persuasive 


1 


5 


Poems 


2 


1 


Letters 


3 


1 


Research Resorts 


0 


1 


SUS Sheets 


7 


5 



•Due to rounding, percentages may not equal UK). 



It is interesting to note that several teachers in both grades commented 
that they did not begin teaching writing until later in the school year. As a 
result, they did not have samples of extended pieces of student writing to 
submit. Instead, these teachers sent in copies of work sheets, short answer 
quizzes, or spelling lists, which were classified as skill sheets. 

At an early stage in classifying students' papers, a distinction was made 
between personal experience narratives and fictional narratives, and between 
informative reports and analytic reports. 14 We believed that these differentia- 
tions would accommodate and acknowledge the variety within both the 
narrative and report classifications. However, during the process of developing 
the scoring guides, the distinctions between the two types of narratives and 
the two types of reports were found to be negligible — the same scoring guide 



11 These categories were based on those used by the California Assessment Program, 1989. 



14 



9 



could be used for both types of narratives and the same scoring guide for both 
types of reports. NAEP classified the papers in these domains, therefore, as 
either narrative or informative. 

Audience 

Often writers' perceptions of their audience and their abilities to clearly 
address audiences are a central factor in effective writing. 15 In addition, 
writing experts have emphasized that having students write for a variety of 
audiences enhances their writing abilities. 18 Although NAEP did not query 
students specifically about the intended audiences of their papers, their 
submissions were analyzed for evidence of intended audience. 

Almost all of the fourth- and eighth-grade papers (93 percent and 96 per- 
cent, respectively) appeared to be written to an unspecified audience. Nothing 
in these papers referred to a particular audience. Less than 1 percent of the 
papers at each grade level were written specifically to the teacher. Also, 
approximately 1 percent at each grade were written to an authority figure or 
parent Less than 3 percent at either grade level were written to a friend or 
to oneself. 

Evidence of the Use of Process Strategies 

When analyzing the students' papers, the readers also looked for evidence of 
the use of writing process strategies, such as revisions of drafts, prewriting 
activities, and peer or teacher collaboration. To locate this evidence, the 
readers considered the pieces submitted by the students, as well as informa- 
tion provided by the teachers about the writing activities. 

As Table 1.2 indicates, less than 50 percent of the papers submitted showed 
evidence of the use of writing process strategies. Of those papers containing 
evidence of revision, only 1 percent at each grade level involved revisions 
beyond changes to the surface features of the papers (i.e., spelling, punctu- 
ation, capitalization). TWenty-one percent at grade 4 and 31 percent at grade 8 
showed evidence of minor revisions. Sixteen percent at grade 4 and 11 percent 
at grade 8 showed evidence of having used other process strategies, such as 
prewriting (brainstorming, reading, discussing topics with family or friends) 
and teacher or peer conferencing. 



,$ William F. Brewer. "Literary Theory, Rhetoric and Stylistics: Implications for Psychology," in 
Theoretical Issues in Reading Comprehension, Rand i. Spiro. Bertram C. Bruce, and William F. 
Brewer, editors {Hillsdale, NJ: Lawrence Erlbaum Associates, 19%). 

i* George Hillocks, Jr., Research on Written Composition: Sew Directions for Teaching (Urbana. IU 
ERIC Clearinghouse on Reading and Communication Skills, 1986). 
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Table L2: Writing Process Strategies 



Grade 4 



(Mil 



% 



% 



Evidisct of otbor prams itrattgiM* 
EvUmci of writhf prectsiy total 



38 



21 



16 



1 



43 



31 



11 



1 



'Other process strategie s include peer or teacher conferencing end prewriting activities. 



It should be noted that several teachers indicated they sent us "clean" 
copies of their students' writing. Although we had asked for drafts and evi- 
dence of students' use of process strategies, the teachers stated that they 
assumed we wanted final, "error-free" versions of students' work with no 
teacher comments on them. To help avoid this confusion in 1992, the direc- 
tions to teachers and students emphasize that any prewriting or drafts avail- 
able for each piece should be included in the portfolios submitted in 1992. 

Evidence of the Use of Resources for Writing 

Another central aspect of recent developments in writing instruction has been 
an emphasis on integrating writing and reading and on the role writing can 
play in promoting learning across the disciplines. 17 While the focus of this 
study was on the writing students did for their English or language arts 
classes, the readers also looked for evidence that students had used outside 
resources when writing their papers as a further clue to the kinds of writing in 
which students engaged. 

Table 13 shows that the resources used for the majority of papers were the 
students' own ideas and observations. This wa f more true for the eighth 
graders than for the fourth graders. Note that the categories overlap — a 
paper may have contained a reference to something read as well as to some- 
thing studied in school. Therefore, if totalled, the percentages may exceed 100 
percent 



17 J. Moffrtt and B. J. Wagner, Student-centered Language Arts raid Reading, K-13: A Handbook for 
"teachers, 3rd edition, (Boston. MA: Houghton Mifflin, 1983'/. 

A. Young and T. Fuhviler (Editors). Writing Across the Disciplines: Research into Practice, (Upper 
Montdair, NJ: Boynton/Cook, 1986). 
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Table 1.3: Evidence oi Resources (or Writing 



Gradt4 



Gn*8 



% 



SfefafsenraMeas, observations 
SoMttiriog rood 
SoMtUogstoMiB school 



76 



87 



12 



14 



13 



6 



Length of Papers and Use of Computers 

One benefit to using students' classroom-based writing is that, under regular 
classroom situations, students have time to write longer texts than they do 
under timed assessment situations. The length of the classroom-based papers 
submitted by the fourth graders in this study ranged from eight words to 
1,250 words, with a median length of 84 words. The papers submitted by 
eighth graders ranged from five words to 4,400 with a median length of 140 
words. 

Although many schools across the country have computers available to 
students, it is in* rating to note that a very small percentage of papers sub- 
mitted for the study »ere presented on computer printouts: 2 percent at the 
fourth grade and 6 percent at the eighth grade. 



Recent theories in literacy education emphasize the benefit of creating rich, 
realistic learning contexts in which students are active participants in the 
development of their reading and writing abilities. 18 Process approaches to 
writing instruction also emphasize the active, meaning-creating aspects of 
writing. 19 Under these approaches teachers alternate between activities that 
require students to select their own topics, purposes, and audiences for writing 
and activities in which the teacher (or other students) specify a topic The goal 
is to give students a wide range of experience with writing. In school and 
beyond school, students will be asked to write for their own as well as for other 
people's purposes. Therefore, a central goal of writing programs is to enable 
students to be effective writers under both self-directed and authority-directed 
conditions. 



18 Angela Jaggar and M. Trika Smith-Burke, Observing the Language Learner, (Newark DE: 
International Reading Association and Urbana. 1L: National Council of Teachers of English. 
1985). 

19 Judith A. Langer and Arthur N. Applebee, How Writing Shapes Thinking: A Study of "teaching 
and Learning, (Urbana, IL: National Council of Teachers of English, 1987). 



Types of Activities 



ERIC 



12 



17 



Fifty percent of the teachers who participated in this study included a brief 
description of the activities that generated their students' writing. Less than 
1 percent of the activity descriptions submitted by teachers at either grade 
indicated that students had been asked to select their own topics. 

The remaining activity descriptions were analyzed and then classified 
according to how specific the activities were and what sources of knowledge 
students were required to draw upon to complete the activities. This analysis 
yielded four main types of activities: genera! prompts, focused prompts, 
content reports, and integrated activities. "Prompts" are any topic, situation, 
stimulus, or assignment given to students to elicit a sample of writing. In 
keeping with recent theories about the importance of context in literacy 
learning, writing instruction and assessment experts maintain that an effec- 
tive writing prompt (or instructional activity) should not only specify a topic 
for the writer, but a clear audience and purpose as well. 20 

Table 1.4 summarizes the percentage of activities in each category. None of 
the persuasive paper; had activity descriptions from the teachers, so only the 
two major domains, narrative and informative, are presented below. 



Table 1.4: Types of Activities* 



General 
Prompts 

Foased 
Pranpts 

Content 
Resorts 



Informative Norr stive Total 

Grab 4 Grab 8 Grab 4 Grab 8 Grade 4 Grade 8 



% 



47 



17 



28 



% 



48 



22 



22 



% 



39 



% 



82 



12 



% 



68 



12 



15 



% 



60 



18 



16 



Activities 



8 



8 



*Dut to rounditift percentages may not equal 100. 



Genet al \ Vriting frompts Sixty-eight percent of the fourth-grade and 
60 pe/cent of the eighth-grade activities could be classified as General Writing 
Prompts. In these types of activities the teachers gave the students a general 



Edward M. White. Teaching end Assessing Writing, (San Francisco, Ck. Josey-Bass Publishers, 
1986). 
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topic about which to write, but did not focus their attention on any single 
aspect of the topic Nor do these prompts make explicit to students an audi- 
ence or purpose for their writing. The overwhelming majority of narrative 
papers fit into this category, as did almost half of the informative papers. 
Below are two examples of this type of activity. 



• Write about Thanksgiving. Choose one of the following topics: J 

• what Thanksgiving means to me or what I am thankful for. • 

I (eighth grade) • 

: • 

l Look at the copy of the photograph I gave you (a bicycle lying * 

• on its side on a country road). Write a story that refers in some J 

• way to this bicycle. * 
I (eighth grade) • 

Focused Writing Prompts Overall. 12 percent of the fourth-grade and 
18 percent of the eighth-grade activities described by the teachers could be 
classified as Focused Writing Prompts. With these activities, teachers specified 
for students not only the topic and the task but an overall purpose. Sometimes 
activities in this category also specified an audience and criteria for effective 
writing. Only 6 percent of the fourth-grade and 12 percent of the eighth-grade 
narrative papers were written in response to focused prompts; 17 percent of 
the fourth-grade and 22 percent of the eighth-grade activities that generated 
informative pieces specified audience and purpose. Below are two examples of 
this type of activity. 



Writing Situation: Your day is going badly. You were late to 
first period, you forgot your math homework, you left your lunch 
on the bus, your pen ran out of ink, and your locker combination 
didn't work! To top it all off, you suddenly realize that since 
yesterday you have shrunk two inches. 

Directions for Writing: Write a story about what happens to 
you next Let your reader know how you feel, what you think and 
see, how people treat you, and what happens after you discover 
you are actually shrinking. Write a readable story that will enter- 
tain and surprise your readers, 
(eighth grade) 
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• Students were asked to write an informative paragraph giving 

• advice to a younger sister or brother about how to get along in 

• school or how to get along with the teacher. 

• (eighth grade) 

Content Reports Although we had asked for papers students had 
written for their English or language arts classes, some students submitted 
papers on science or social studies topics, indicating the use of writing acrosi 
the curriculum. 

Overall, 15 percent of the fourth-grade and 16 percent of the eighth-grade 
activities fit into the third category. Content Reports. These activities required 
that students write papers reporting on information they learned from class- 
work and/or readings. Papers about historical figures or concepts in science 
are examples of this type of activity. Also in this group are book reviews and 
reactions to fictional stories. 

Only 1 percent of the fourth-grade and 5 percent of the eighth-grade narra- 
tive activities fit into this category. Twenty-eight percent of the fourth-grade 
and 22 percent of the eighth-grade informatives were Content Reports. Below 
are two examples. 

• After all of the students read a story that dealt with emotional \ 

• change, t ie students were told to write their own story involving ( 

• an emotional change. They were to use the one they had read in . 

• class as a model. ! 
; (eighth grade) ; 

• Based on our lesson about Paul Revere, write a dialog < 
" between Paul Revere and a newspaper interviewer. The inter- \ 
I viewer should ask Paul Revere for details about his role in ' 

• the American Revolution. < 

• (eighth grade) _ A ! 

Integrated Activities Very few of the activities, 6 percent at both grades 
4 and 8, appeared to be part of multi-day, multi-stage, integrated activities, 
where teachers engaged students in a series of classroom activities around a 
central theme or text Below is an example of this type of activity. 
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1. Story starters were distributed to students (such as: "Tom 
Turkey was a big turkey. Now I don't mean an ordinary big 
turkey. No sir! ! mean an extraordinary, gigantic turkey. In 
fact, Tom Turkey was so big that. . ."). 

2. The class brainstormed together. They shared ideas about the 
different story starters, jotting down notes for their own 
papers. 

3. Students selected one of the story starters and wrote first 
drafts of a story. 

4. The next day, they divided into groups of three to share their 
first drafts. Croup members offered ideas to revise/improve 
each others' stories. They also helped with sentence structure 
and other grammatical problems. 

5. The third day, proofreading guidelines were discussed and 
students worked in pairs to proofread each others' stories. 

6. Students prepared a final draft of their stories and shared them 
as part of the Thanksgiving celebration. 

(fourth grade) 



Summary 

Although participants in this study came from different classrooms in differ- 
ent schools across the country, and they wrote on a wide * ariety of topics, the 
papers they submitted had some commonalities. Most of the papers we re- 
ceived were either informative or narrative pieces, written for an unspecified 
audience, in response to general writing prompts or content report activities 
from their teachers. Less than half of the papers showed evidence that their 
writers had employed process strategies in producing them, and most were 
based on the students' own ideas and observations. In addition, the papers at 
both grade levels varied widely in length, while few were written on computer. 

One of the major lessons we learned from our initial examination of the 
students' classroom-based writing was the need to collect more systematic 
information about the types of activities in which students had engaged. As 
part of the 1992 NAEP Portfolio Study design, a brief teacher questionnaire, 
asking for more specific information about the activities that generate the 
writing students select for their portfolios, is included. Also, students are 
asked to write a letter explaining why they included the pieces they selected. 
Likewise, the need to include evidence or information about the use of process 
strategies is emphasized in the directions to both students and teachers. 
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Evaluating the Writing 



Developing Evaluative Grides 

In order to broaden the information gained about students' classroom-based 
writing performance as well as the context for writing, NAEP wanted to 
explore the feasibility of evaluating writing obtained from a variety of prompts 
or activities. For its regular writing assessments, NAEP typically develops 
specific scoring guides for each of its writing prompts. The limitations of this 
approach for evaluating diverse samples of school-based writing are obvious. 
With more than 250 classrooms involved in this study, developing a scoring 
guide for each unique assignment would be impossible. Therefore, NAEP 
explored the idea of developing scoring guides specific to each of the major 
domains identified through our descriptive analysis: narrative, informative, 
and persuasive. To accomplish the task of developing domain-specific scoring 
guides. NAEP assembled a team of elementary teachers, secondary teachers, 
and teacher educators. 

Using samples of the writing, NAEP staff worked with the team of teachers 
to develop scoring guides for the two most commonly submitted domains: 
informative and narrative. Because NAEP also assesses students' persuasive 
writing in the regular assessment, we developed a scoring guide for the per- 
suasive papers, even though very few persuasive papers were submitted. The 
process the team of teachers used to develop the guides involved three major 
stages: reading and sorting; classifying and consensus: and describing and 
confirming. 

Reading and Sorting Beginning with the informative pieces, the team 
first read approximately 60 randomly selected papers from each grade level, 
which comprised about 10 percent of all the informative papers. Based on a 
genera], holistic impression, team members sorted the papers into four to six 
groups ranging from highest to lowest. 

This stage involved confirming that all of the papers first classified as 
informative were genuinely informative. The team defined informative as 
those papers that had, implicitly or explicitly, the purpose of conveying infor- 
mation or ideas. Thank you letters and opinion statements are examples of 
some of the papers that were reclassified because their purposes were not 
primarily informative. Research papers that used more than five reference 
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sources, although informative in purpose, were so much longer than most of 
the other informative papers that they were placed in a separate category. 

Also, papers in which the teacher provided students with the first sentence 
to each paragraph seemed more like elaborated fill-in-the-blank worksheets 
than original papers. These were reclassified as skill sheets. 

Classifying and Consensus Next, the readers compared the way they 
each had sorted the papers, discussing which papers represented high, me- 
dium, and low levels of performance. In the process, they discussed a range of 
criteria that could be used to evaluate writing in general and informative 
writing in particular. Their goal was to identify levels of development in 
informative writing. 

To this end. the team decided to focus on the cognitive elements of the 
papers. When rereading the papers, they asked themselves, "How much 
information is the student conveying in the paper?" "What kinds of relation- 
ships do the writers establish between the ideas and information?" "How 
developed are the ideas and information?" 

As the discussion progressed, the team members articulated the criteria 
they each used to place papers into categories. This discussion continued until 
a common set of criteria could be agreed upon and specified. 

Describing and Confirming Using the common set of criteria, the 
team then described a range of performance for informative writing. Papers 
that exemplified each level of performance were selected. The team then 
applied the criteria to a new set of papers from each grade level (another 10 
percent of the informative papers), refining their descriptions. 

At first, the fourth- and eighth-grade papers were read separately, the plan 
being to develop different guides for each grade level. However, after the 
informative guide had been developed for the fourth-grade papers, and the 
group moved on to consider the eighth-grade informative pieces, they found 
that the same criteria could be applied to both grades. 

The procedures outlined above also were used to develop scoring guides for 
the narrative and persuasive pieces. Narrative papers were defined as pieces 
that described a sequence of events, real or imagined. Persuasive papers were 
those letters, paragraphs, or essays that stated a position or opinion primarily 
for the purpose of persuading or convincing. The idea of developing one 
gener' 1 scoring guide for all papers was discussed. However, the scoring guide 
development team concluded that the purposes and methods of development 
for the three domains were so different that they required separate sets of 
criteria for evaluation. 
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Figures 2.1, 2.2. and 2.3 present the three scoring guides developed. Each 
guide ciassifies papers into six main levels. Later in the chapter, samples of 
students' papers are presented for each of the levels within these guides. 

The Narrative Scoring Guide In reading and evaluating the narrative 
papers, the scoring guide development team focused on several key features 
of narrative writing. First, they loosely defined a story as a series of related 
events or happenings. Hence, the first level of the narrative scoring guide is 
not termed a "story," but an Event Description becausv only one event is 
described. 



Figure 2.1: Narrative Scoring Guide 



1 Event Description. Paper is a list of sentences minimally related or a list 
of sentences that all describe a single event. 

2 Undeveloped Story. Paper is a listing of related events. More than one 
event is described, but with few details about setting, characters, or the 
events. (Usually then is no more than one sentence telling about each 
event.) 

3 Bosk Story. Paper describes a series of events, giving details (in at least 
two or three sentences) about some aspect of the story (the events, the 
characters' goals, or problems to be f.lved). But the story lacks cohe- 
sion because of problems with syntax, sequencing, events missing, or an 
undeveloped ending. 

4 Extent Story. Paper describes a sequence of episodes, including 
details about most story elements (i.e., setting, episodes, characters' 
goals, problems to be solved). But the stories are confusing or incom- 
plete (i.e.. at the end the characters' goals are ignored or problems 
inadequately resolved: the beginning does not match the rest of the 
story; the internal logic or plausibility of characters' actions is not 
maintained). 

5 Developed Story. Paper describes a sequence of episodes in which 
almost all story elements are clearly developed (i.e., setting, episodes, 
characters' goals, or problems to be solved) with a simple resolution of 
these goals or problems at the enJ. May have one or two problems or 
include too much detail. 

6 Elaborated Story. Paper describes a sequence of episodes in which 
almost ail story elements are well developed (i.e.. setting, episodes, 
characters' goals, or problems to be solved). The resolution of the goals 
or problems at the end are elaborated. The events are presented and 
elaborated in a cohesive way. 
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The second feature the team saw as differentiating among the narrative 
papers was amount of development. The main difference between the second 
and third levels of the narrative guide is that, in a Basic Story, one aspect of 
the story is somewhat developed, whereas no aspects of an Undeveloped Story 
are presented in any detail. The difference between the third and fourth levels 
is that many of the events of an Extended Story are somewhat developed at 
the fourth level. At the fifth level {Developed Story) almost all of the events are 
described in detail. 

The third feature of narrative writing the team used to evaluate the papers 
was quality of development. Papers classified at the upper two levels, Devel- 
oped Story and Elaborated Story, not only contained detailed episodes, but 
also included some source of tension or conflict (characters' goals, problems 
to be solved, mysteries to be unravelled). These two levels differ in the author's 
success in establishing and resolving the tension or conflict. While in Devel- 
oped Stories tension is clearly (and often creatively) established, it is not 
completely resolved: in Elaborated Stories the tension is both clearly estab- 
lished and completely resolved. 

The Informative Scoring Guide In reading and evaluating the 
informative papers, the scoring guide development team focused on several 
key traits of informative writing. First, they loosely defined informative writ- 
ing as the presentation of information and ideas for the purpose of informing 
an audience. Further, in the process of presenting information, the writer 
establishes relationships between pieces of information and/or ideas. The 
papers were then classified according to how well the writers had succeeded 
in establishing relationships and according to how well they presented the 
information to a particular audience for a specific purpose. 

The differences between levels one through four are the degree to which 
the writers established relationships between the pieces of information in 
their papers. The difference between levels five and six is the degree to which 
the writers conveyed a sense of audience and purpose. This was often accom- 
plished through the use of an overt type of organizational structure. 
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Figure 2.2: Informative Scoring Guide 



1 Ustiftg. Paper lists pieces of information or ideas ail on the same topic, 
but does not relate them. A range of information/ideas is presented. 

2 Attempted Wswsrioa. Paper includes several pieces of information and 
some range of information. In part of the paper, an attempt is made to 
relate some of the information (in a sentence or two), but relationships 
are not clearly established because ideas are incomplete or undeveloped 
(the amount of explanation and details is limited). 

3 Undeveloped Disassioo. Paper includes a broad range of information 
and attempts to relate some of the pieces of information. The relation- 
ships are somewhat established, but not completely. The ideas are 
confused, contradictory, out of sequence, illogical, or undeveloped. 

4 Discvssfoi. Paper includes a broad range of information and. in at 
least one section, clearly relates the information using rhetorical 
devices (such as temporal order, classification, comparison/contrast, 
cause and effect, problem/solution, goals/resolutions, predictions, 
speculations, suppositions, drawing conclusions, point of view, ranking, 
exemplification). 

5 Partially Developed Discossta. Paper includes a broad range of informa- 
tion and establishes more than one kind of relationship using rhetorical 
devices, such as those listed above. Information and relationships are 
well developed, with explanations and supporting details. Paragraphs 
are well formed but the paper lacks an overriding sense of purpose and 
cohesion. 

6 Developed Msonsiea. Paper includes a broad range of information and 
establishes more than one kind of relationship using rhetorical devices, 
such as those listed above. Information and relationships are explained 
and supported. The paper has a coherent sense of purpose and audience, 
and is free from grammatical problems. An overt organizational struc- 
ture is used (such as the traditional essay format). 

The Persuasive Scoring Guide In reading and evaluating the persua- 
sive papers, the scoring guide development team focused on several key 
features of persuasive discourse: stating an opinion or position, supporting 
one's opinion with reasons and/or explanation, and attempting to diffuse or 
refute the opposing position. While developing an argument by clearly stating 
and supporting an opinion may be considered an effective way of persuading 
an audience, the team felt that papers which include the recognition and 
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refutation of an opposing viewpoint to be more complex forms of persuasion. 
They placed the 58 persuasive papers submitted by students along a con- 
tinuum of persuasive complexity, ranging from opinion to argumentation to 
refutation. 



Figure 2.3; Persuasive Scoring Guide 



1 OpMon. Paper is a statement of opinion . but no reasons are given to 
support the opinion, or the reasons given are inconsistent or unrelated 
to the opinion. 

2 Extended Opinion. Paper states opinion and gives reasons to support the 
opinion, but the reasons are not explained or the explanations given are 
incoherent. 

3 PortioHy Developed Argument. Paper states opinion and gives reasons to 
support the opinion, plus attempts to develop the opinion with further 
explanation. However, the explanations are given but not developed or 
elaborated. May contain a brief reference to the opposite point of view. 

4 Developed Argument. Paper states opinion, gives reasons to support the 
opinion, plus explanations, with at least one explanation developed 
through the use of rhetorical devices (such as sequence of events, cause 
and effect, comparison/contrast, classification, problem/solution, point 
of view, drawing conclusions). May contain a brief summary of the 
opposite point of »*k w. 

5 Portiefly Developed Refoisnon. Paper states opinion, gives reasons to 
support opinion, explanations, plus attempts to discuss and/or refute 
the opposite point of view. Contains an adequate summary of the 
opposite point of view. 

6 Developed Refutation. Paper states opinion, gives reasons to support 
opinion, explanations, plus a discussion and/or refutation of opposing 
point of view. Refutation is clear and explicit — summarizes opposite 
point of view and discusses why it is limited or incorrect. 

Applying the Evaluative Guides 

Scoring the I i riting After the scoring guides were developed, another 
group Of teachers (16 elementary, secondary, and college teachers) was trained 
to apply the scoring guidelines to the papers. The training consisted of two 
stages: explanation and application. On the first day, the informative scoring 
guide was presented and explained to the readers, along with samples of 
papers at each level. 
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After questions and discussion, the whole group applied the guide to the 
same set of 10 informative papers. In small groups, the readers compared the 
scores they assigned and then the whole group discussed each paper and 
reached consensus on how it should be scored This process was repeated with 
another set of 10 papers, until group members felt confident that they could 
apply the scoring guideline consistently and reliably. 

The group then scored all of the informative papers. The training proce- 
dures were repeated the next day for the narrative papers. Because the number 
of persuasive papers was small, they were scored by members of the team who 
had developed the scoring guides, rather than by the group of 16 readers 

Interrater Agreement Thirty percent of the papers in each domain 
received a blind second scoring — the second reader could not see the score 
given to the paper by the first reader. Table 2.1 presents the rate of reliability 
and agreement between the two readers. 

The reliability coefficient is a correlation between the scores assigned to 
papers by the first and second readers, taking into account not only when two 
scorers disagreed but also the size of their disagreement. Coefficients above a 
.80 are considered strong and above .65 are considered good. 

With a six-point scale, agreement within one score point, which is called 
adjacent agreement, often is also calculated. This is done because increasing 
the size of a scale requires that readers make more refined distinctions be- 
tween each level. Any percentage adjacent agreement above 90 is considered 
strong. Both measures of reliability are presented in Table 2.1. 



Table 2J: Interrater Reliabilities 
and Percent Adjacent Agreement 



NflrrativM 





n.ti.kifttn 
RtHBWy 


Percent Adjacent 




Cotffktaf 


Agreement 


Forth 


.76 


100 


Eighth 


.82 


96 


Fowlh 


.89 


100 


Eighth 


.88 


99 


forth 






Bahth 


.76 


96 



Perowsh w* 



•There was an insufficient number of persuasive papers at the fourth grade to compute valid statistics. Interpret 
the eighth-grade persuasive statistics with caution due to the small sample site. Note: The scoring was based 
on a six-point scale. 
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The following section presents the percentage of papers, by grade level, at 
each performance level of the narrative, informative, and persuasive scoring 
guides. Due to rounding, percentages may not equal 100. 



Narrative Papers Figure 2.4 presents the percentage of narrative papers 
at grades 4 and 8 at each performance level of the scoring guide. At the fourth 
grade, 11 percent of the students' papers were classified as Event Descriptions, 
57 percent as Undeveloped Stories, 26 percent as Basic Stories, 5 percent as 
Extended Stories, and 1 percent as Developed Stories. 



Figure 2.4: Narrative Papers* 



N = 389 (Fourth Graders) 
N = 315 (Eighth Graders) 




Event Undeveloped Bask Eiteaded Developed 

Description Story Story Story Story 

1 2 3 4 5 

*Due to rounding, percentages may not equal 100. 



0% 0% 

Elaborated 
Story 
6 



As might be expected, more of the eighth-grade papers received higher 
ratings than did the fourth-grade papers. Three percent of the eighth-grade 
papers were rated as Event Descriptions, 35 percent as Undeveloped Stories, 
34 percent as Basic Stories, 19 percent as Extended Stories, and 8 percent as 
Developed Stories. None of the fourth- or eighth-grade papers were classified 
as Elaborated Stories. 
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Informative Papers Figure 2.5 presents the percentage of informative 
papers at grades 4 and 8 at each performance level of the scoring guide. At the 
fourth grade, 31 percent of the papers were classified as Listings, 41 percent as 
Attempted Discussions, 17 percent as Undeveloped Discussions, 9 percent as 
Discussions, and 2 percent as Partially Developed Discussions. 



Figure 2.5: Informative Papers* 



Mo559 (terra Graders) 
N = 628 (Bgsfh Graders) 





o% o% 



listing Attested IMtvtJoptd Wscrofew PartfaSy Developed 
1 DiscMiioa Dbcwskw 4 Developed Dbtwskw 
2 3 Dbossloi 6 

5 

•Due to rounding, percentages may not equal 100. 

As with the narratives papers, more of the eighth-grade informative papers 
received higher ratings than did the fourth-grade papers. Thirteen percent of 
the papers were classified as Listings, 30 percent as Attempted Discussions, 27 
percent as Undeveloped Discussions, 22 percent as Discussions, and 8 percent 
as Partially Developed Discussions. None of the fourth- or eighth-grade papers 
were classified as Developed Discussions. 
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Persuasive Papers Figure 2.6 presents the percentage of persuasive 
papers at grades 4 and 8 at each level of the scoring guide. Please note that 
only eight of the papers submitted by fourth graders and 50 papers submitted 
by eighth graders were persuasive, so the percentages below should be inter- 
preted with caution. 



Figure 2.6: Persuasive Papers* 




OpUoa Exfidvfd Pvtioly Pw i fap td Perfidy DwtJofwd 

I upm uwwopw Afgmtin utYtfoptfl Ksnmnton 

2 ArgmMRt 4 Rffpfofm 6 

3 5 



•Due to rounding, percentages may not equal 100. 

At the fourth grade, 25 percent of the papers were classified as Opinions, 50 
percent as extended Opinions, and 25 percent as Partially Developed Argu- 
ments. At the eighth grade, 6 percent of the papers were classified as Opinions, 
40 percent as Extended Opinions, 32 percent as Partially Developed Argu- 
' merits, and 22 percent as Developed Arguments. None of the persuasive 
papers at either grade was classified as Partially Developed Refutations 
or Developed Refutations. 
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Writing Process Strategies Due to the interest educators have in the 
effect the use of writing process strategies has on students' writing, a further 
analysis was conducted. The scores students' school-based papers received 
were compared to their use of writing process strategies and use of resources 
for writing. Appendix B presents a detailed summary of these comparisons. 

There were slight, statistically nonsignificant differences between the scores 
a paper received and the likelihood that the writer had employed process 
strategies at both fourth arid eighth grades. Likewise, an analysis of students' 
us~ of resources for writing revealed nonsignificant differences between the 
scores their school-based papers received and their use of either their own 
ideas, something read, or something studied in school when writing their 
papers. 

As was mentioned in Chapter One. although we had requested papers that 
showed the use of process strategies, less than half of the papers submitted 
contained evidence of the use of these strategies. Likewise, only half of the 
papers were accompanied by a description from the teacher of the activities 
that had generated the papers. Therefore, the comparisons made in this study 
between the ratings students' school-based writing received and their reported 
use of process strategies and resources for writing are presented for informa- 
tion only. 

The 1992 NAEP portfolio study will collect more detailed information about 
writing process strategies and if all goes well, present more complete infor- 
mation about the relationships between students' use of these processes and 
their writing achievements. 

In the next three sections, examples of i tudcnts' papers are presented for 
each performance level of the t'iree scoring guides, along with an explanation 
of how each paper exemplifies the level. A note about our selections: many 
stories submitted by students, esp? ially by the eighth graders, could be 
classified as horror stories. Our samples of the narrative scoring guide reflect 
this preponderance of thrillers. Also, the selection of examples was limited to 
the papers that could be reproduced legibly. 

In addition, the papers at the upper end of the scales are much longer than 
those at the lower end. While length alone was not a consideration, all three 
scoring guides value development of ideas, information, or the elements of 
narratives. Therefore, it would be difficult for a brief paper (one or two para- 
graphs) to place above a three on any of these scales. 
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Examples of the Narrative Scoring Guide 

Event Description (score of I) Papers classified as event descriptions 
teil about one event Basically, they say, "such and such happened." Some of 
the papers in this category give details about the setting and so appear to be 
more elaborate stories. However, they end with a description of a single event, 
rather than a series of events. The paper below, written by a fourth grader, is 
an example of a simple Event Description. 

SEE - W-- --^F^^rSE 

n//? /i; . 



Undeveloped Story (score of 2) Papers classified as Undeveloped 
Stories tell about a series of events. Basically, they say, "one day this happened, 
then something else happened, and then another thing happened." However, 
the events, as well as the setting and characters, are only briefly described. The 
writers give very few details about each event; the story is a listing of related 
events. 
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These stories are similar to front-page newspaper reports, where the basic 
facts of a story are reported (who, what, when, where) but few details about 
why events happened are presented. For example, in the paper below, the 
fourth-grade writer uses one sentence to describe each event 
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Basic Story (score of 3} In papers classified as Basic Stories, the 
writers go one step beyond a simple listing of related events. One aspect of the 
story (the events, the characters' goals, or the setting) is somewhat developed. 
However, these stories lack a sense of cohesion and completeness. Events may 
be presented out of sequence, some aspect of the story may be confusing due 
to problems with syntax, or a key event may be unclear. For example, in the 
paper below, the fourth-grade writer describes a series of events and, at the 
beginning, develops a problem in some detail (a librarian who puts books away 
too quickly). However, the resolution to the problem, although humorous, is 
not well developed. 



CLuuc»^f-\ ouyyjdi &O^Kj jJko/rru o-ojf" 




/yxsAJT JtAsrctfu ztfitLA^— AAjcrcJkJ 
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Extended Story (score of 4) Extended Storks go beyond Basic Stories 
in that many of the events in these stories are elaborated to some degree. This 
degree of development gives a sense of a sequence of distinct story episodes. 
Details are given about the setting, the characters' goals, problems to be 
solved, and the key events. Yet, these stories may be somewhat incomplete in 
that the characters' goals may be left unresolved or the problem posed in the 
story's opening never solved. The ending may not match the beginning or the 
story's ending may be inconsistent with the internal logic established 
throughout the rest of the story. Or, as in the example below (written by an 
eighth grader), they may be very satisfying, yet not elaborately developed. 

It is important to note that, while Extended Stories are not as elaborated or 
complex as are Developed Stories and Elaborated Stories, they are successful 
stories — all of the key story elements and events are clearly presented. They 
are the simplest type of complete story on this scale. 
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Developed Story (score of 5) Developed Stories describe a sequence 
of episodes in which almost all of the events and story elements are some- 
what elaborated. Yet, one aspect of these stories is not well developed, such 
as the ending or a crucial event In the example below (written by an eighth 
grader), each episode is somewhat developed, but could be further elaborated. 



J3»Mju, J>\4~k JCblA Jl£o<AJu*~ 0-^ M±A- sO&Lps - 
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Elaborated Story (score of 6) No papers were considered to be Elabo- 
rated Stories, lb be classified as elaborated, stories had to present a sequence 
of episodes in which almost all of the events and story elements were well 
developed Goals or problems introduced in the beginning were well resolved 
by the end, characters' motives were well developed, and the entire storv was a 
cohesive, unified whole. 

In the example below, the eighth-grade writer of "The Black Rose" retells 
the plot of a Halloween movie. In it, the writer effectively presents each 
episode, leading to a spine-tingling ending. The only discordant note is the 
occasional switching of narrative voice between first person and third person. 
A revising of this story that included a consistent use of narrative voice would 
make this an example of an Elaborated Story. (As is, this story received a score 
of 5.) 
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Ejuupbs of Mm Infonwrtfva Scorfag Grids 

Listing (score of I) m ^ nrst category, Listing, the writer presents 
pieces of information or ideas all on the same topic While the papers may 
contain a range of information about the topics, no attempt is made to relate 
the ideas or information. For example, in the paper below, the fourth-grade 
writer lists a series of facts about bones, but these facts are not connected to 
each other, except that they are each about bones. 
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Attempted Discussion (score of 2) As with papers classified aslisf- 
mgs, Attempted Discussions present a range of information or ideas about a 
topic but they go beyond Listings because some attempt is made to establish 
relationships between the pieces of information or ideas. However, these 
relationships are not clearly established. The ideas or information may be 
incomplete or undeveloped. 

For example, in the paper below the fourth-grade writer presents a range of 
information about horses and, in the first and second sentences, begins to 
develop the subtopics of color and diet by giving examples. Yet, these examples 
are only mentioned in passing and are not developed enough to present a 
generalized view of horses supported by detail. 



v. 
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Undeveloped Discussion (score of 3) Papers classified as Undevel- 
oped Discussions go beyond Attempted Discussions in that the attempt to 
establish relationships between ideas or information is more successful. Clear 
connections are made between information or ideas in at least one part of the 
paper. However, the information and ideas are not well developed. They may 
be confused, contradictory, out of sequence, illogical, or undeveloped. 

For example, in the paper below (written by an eighth grader), the writer 
explains how watching television might influence students. This is more than 
a simple assertion that television influences viewers and more than a listing of 
the ways it can influence viewers. Through a brief description of a scenario, 
the writer explores the mechanism by which students can be influenced. 
While this approach is effective, the ideas are not developed or elaborated: the 
paper is more the beginning of a discussion on the topic than a complete 
discussion of the issues involved. 
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Discussion (score of 4) 



Discussions are more complex than At- 



tempted Discussions or Undeveloped Discussions because, in at least one 
section, the writers clearly relate the ideas or information. A signal of this 
level of development is the use of rhetorical devices (such as temporal order, 
classification, definition, comparison/contrast, cause and effect, problem/ 
solution, goals/resolutions, predictions, speculations, drawing conclusions, 
point of view, ranking by importance, exemplification) to relate some of the 
information and ideas presented However, these papers do not take the next 
step and relate all of the ideas or information presented to an overarching 
purpose. Thus, while these papers retain their focus on the main topic being 
addressed, they also seem to skip from subtopic to subtopic. 

For example, in the paper below, the fourth-grade writer gives a range of 
information about opossums. Each paragraph deals with a specific aspect of 
opossums and the writer uses examples to illustrate and explain these acper.s 
(i.e., in the third paragraph, the writer employs several examples to illustrate 
the small size of baby opossums). Yet the paper does not have an overall sense 
of purpose — there is no apparent reason for the ordering of these pieces of 
information about opossums. 
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Partially Developed Discussion (score of 5) In Partially Developed 
Discussions, information and relationships are established and well developed, 
with explanations and supporting details. The paragraphs tend to be unified 
and well formed. However, the paper lacks an overriding sense ot purpose, 
audience, and cohesion. The writers of these papers present a wide range of 
information on a topic, organize this information clearly, develop most of the 
aspects of this topic, yet do not create a context for their discussion that 
envisions a wider communicative purpose. 

For example, the fourth-grade writer of the paper below has a definite voice, 
exhibit'ng much enthusiasm about the topic. Each paragraph develops a piece 
of information about bison, including transitions from one subtopic to the 
next However, what is missing is a sense of audience and the overall purpose 
for writing about bison. Despite the writer's clear voice and effective manage- 
ment of details, it is unclear to whom the paper is directed and for what 
purpose. 
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Developed Discussion (score of 6) For papers to be considered 
Developed Discussions they had to contain all the elements of the previous 
category, and also present a coherent sense of purpose and audience. A signal 
of this level of writing is the overt use of organizational structure and excel- 
lent command of the conventions of written English. No papers in the 1990 
sample were rated as Developed Discussions. 

Examples of the Persuasive Scoring Guide 

Opinion (score of I) In the first type of persuasive writing, Opinions, 
the writers assert an opinion, but do not develop or explain this opinion in any 
detail. Sometimes they give reasons to support their opinion, but these rea- 
sons are unrelated to the opinion or contradict one another. For example, the 
paper below, written by a fourth grader, states an opinion about trick-or- 
treating ("it is fun") with one reason to support this opinion ("you get lots of 
candy"). Then the writer gives several pieces of information relating to the 
danger of trick-or-treating that seem either unrelated or contradictory to the 
opinion that trick-or-treating is fun. 

C&r? op amd oft Idio tamoU^ .,tU iDwisA 
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Extended Opinion (score of '2) Extended Opinions include a state- 
ment of opinion and reasons to support the opinion. However, the reasons are 
only briefly presented or the explanations are confusing. 

For example, the paper below, written by an eighth grader, states an opinion 
CI would like to go to the foir by myself.") and lists several reasons in support 
of this opinion ("I am old enough," "I have a job to keep money," and "I am 
responsible."). The last reason is somewhat elaborated ("I take care of the 
house and everything."). However, this elaboration is not directly connected to 
the opinion — it does not explain why taking care of the house makes one 
responsible enough to go to a fair alone. 




Partially Developed Argument (score of 3) Partially Developed 
Arguments include an opinion statement and clear reasons to support the 
opinion. They also contain attempts to develop the opinion with further 
explanation. However, the explanations given are not developed or elaborated. 
These papers may also contain an implicit reference to an opposing point of 
view opposite to their own. 

For example, the eighth-grade writer of the paper below states an opinion 
("Students must behave during open lunch.") and gives elaborated reasons to 
support this opinion. However, the reasons and elaborations are confusing. 
The first paragraph seems to relate, implicitly, to an opposing point of view, 
the second paragraph to potential rewards, and the third paragraph to actual 
rewards. 
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Developed Argument (score of 4) in Developed Arguments, writers 
state their opinions with reasons to support those opinions. They also include 
at least one explanation that is well developed. Rhetorical devices (such as 
sequence of events, comparison/contrast, problem/solution, and classification) 
may be used to develop the explanation. These papers may also contain a brief 
summary of the opposite point of view. 

For example, in the paper below, the eighth-grade writer presents a clear 
opinion, with elaborated reasons to support the opinion. In addition, in the 
third paragraph, the writer briefly mentions and addresses the opposing point 
of view. 
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Partially Developed Refutation and Developed Refutation (scores of 5 
and 6) Of the 58 papers classified as Persuasive, none fit into these last 
two categories. Yet, the team of teachers who developed the scoring guides 
emphasized that these two performance levels of persuasive writing should be 
described. Noting the limited number of persuasive papers received and the 
important role refutation plays in persuasive discourse, the team wanted to 
identify the characteristics of persuasive papers that contained more overt and 
complex refutations. 

Partially Developed Refutations include a clear opinion statement, with 
reasons to support the opinion and elaborated explanations. These papers also 
contain an adequate summary of the opposite point of view and may include an 
attempt to discuss the opposing position. 

Developed Refutations are papers that have opinion statements, reasons to 
support the opinion, explanations of these reasons, plus a discussion and/or 
refutation of the opposing point of view. The refutation is clear and explicit, 
including a discussion of why the opposing viewpoint is limited or incorrect 

Summary of Performance Across Domains 

In order to develop a portfolio of students' writing at grades 4 and 8, we sum- 
marized their performance across the three domains by grade level. Table 2.2 
presents the fourth graders' performance at eacl. domain by grouping the 
levels of each scale into low (scores of 1 and 2), medium (scores of 3 and 4), 
and high (scores of 5 and 6). 

While slightly more of the informative and persuasive papers submitted by 
the fourth graders received higher ratings than did their narrative papers, in 
general, the ratings assigned papers across the three domains of narrative, 
informative, and persuasive were very similar. 
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Tobie 2.2: fourth Guide? s : Classroom- Based 
Writing Pcrionncincc' 
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•Due to rounding, percentages may not equal 100. 

•Interpret statistics on persuasive papers with caution due to small sample size. 



"Bible 23 presents the eighth graders' performance at the low, medium, and 
high levels of each genre. As with the fourth graders, there was little differ- 
ence in the distribution of scores among the three domains. As might be 
expected, compared with the fourth grade, more eight' i-grade papers received 
medium and high ratings. 
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The results of this study indicate that more than half of the fourth-grade 
narrative papers simply listed a series of related events, while over one-quarter 
contained some elaboration. Few of the fourth-grade stories contained devel- 
oped characters or plots. Also, approximately one-third of the fourth-grade 
informative papers were simple listings of information or ideas. More than half 
of the fourth-grade informative papers attempted to discuss topics by trying to 
establish relationships between the pieces of information or ideas. In 9 percent 
of the fourth-grade informative papers relationships were successfully estab- 
lished between several ideas in the papers. As might be expected at grade 4, 
few (only 2 percent) wrote papers where almost all of the information was 
related. For persuasive writing, the few papers that were written by fourth 
graders were opinion statements, some with explanation. In two papers, tht 
argument was partially developed. 

The eighth-grade narrative papers were, for the most part, simple or basic 
stories (68 percent). Compared with the fourth graders, fewer eighth graders 
wrote Undeveloped Stories and more wrote Basic Stories. As might be ex- 
pected, more eighth graders (about one-quarter) than fourth graders wrote 
Extended and Developed Stories. The same trend holds true for the eighth- 
grade informative papers, with only 13 percent of the eighth graders simply 
listing information or ideas. The older students were more successful at 
establishing relationships between ideas and information: fewer eighth-grade 
than fourth-grade papers were rated as Attempted Discussions (30 percent) 
and more were rated as Undeveloped Discussions or Discussions (49 percent). 
At the upper end of the informative scale, 8 percent of the eighth graders 
wrote papers in which almost all of the information presented was cogently 
related. For persuasive writing, fewer eighth than fourth graders wrote simple 
Opinion statements (6 percent compared to 25 percent, respectively) and 
fewer wrote Extended Opinions (40 percent compared to 50 percent, respec- 
tively). However, it is interesting that similar percentages of fourth and eighth 
graders wrote papers classified as Partially Developed Arguments, while 
almost one-quarter of the eighth graders wrote Developed Arguments. 

It is important to note that the panel that developed the scoring guides, 
while depending for the most part on the group of papers submitted by par- 
ticipants in this study to specify a range of performance, also relied on their 
experience as teachers and teacher educators in establishing the upper ends of 
each of the three scales. They felt it was possible and desirable to project, 
based on the few upper-range papers and their own knowledge of written 
discourse, the key features of complex narrative, informative, and persuasive 
papers. Likewise, it should be noted that, in the scoring guides developed for 
this study, creativity independent of development did not influence the scores 
papers received. 
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Comparing Methods of 
Assessment 



Collecting samples of students' writing produced under traditional essay 
assessment methods and writing produced under more typical classroom- 
based conditions creates a unique opportunity to compare these methods of 
assessment It makes possible an exploration of a number of questions con- 
cerning what we learn about students' writing from essay tests, on the one 
hand, and from school-based samples of writing, on the other. 

The first part of this chapter compares the key features of these two ap- 
proaches to ? cessment — the characteristics of the texts generated and the 
nature of the processes in which students engaged. In the second section, the 
ratings that a subset of the students' writing received on the regular NAEP 
writing assessment are compared with the ratings their classroom-based 
writing received. In the last part of this chapter, the major lessons learned 
from this pilot portfolio study are discussed. 

Features of tin Assessments 

Characteristics of the Writirg Earlier in this report, several charac- 
teristics of student!:' writing were analyzed: type of writing, intended audience, 
type of activity, and length of papers. These will be the focus of the comparison 
between the writing provided under traditional assessment conditions and the 
writing collected for the school-based study. 

In the 1990 NAEP writing assessment, students responded to two 15- 
minute prompts. 21 As a result of an elaborate development and review process, 
which included field testing, NAEP prompts are characteristically very clear 
and specific The prompts span three types of writing: informative, narrative, 
and persuasive. In 1990, students were asked to write to a variety of audiences 
(i.e., teachers, principals, school newspapers, peers, political figures) about a 
range of topics. Some of the topics included: (1) writing a letter to a company 
requesting a course of action; (2) writing a newspaper article based on given 



n The 1990 NAEP assessment was a trend assessment — prompts developed in 1984 were 
readministered in 1990 unchanged. Due to recent changes in the field of writing, the 1992 NAEP 
writing assessment consists of 2S-minuts prompts at fourth, eighth, and twelfth grades and 
several 50-minute prompts at the eighth and twelfth grades. 
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information about a haunted house; (3) writing a paper taking a stand on the 
dissection of frogs in a science class; (4) writing a letter to a radio station 
manager convincing him/her to allow the class to visit the radio station; and 
(5) writing a story about imagined adventures with a flashlight that had 
special powers. The prompts required that students draw on their own experi- 
ences as well as on information presented in the prompt Given the limited 
amount of time students had to write in response to the prompts, it is not 
surprising that, in the 1990 NAEP assessment, the average length of fourth 
graders' responses was 34 words and the average length of eighth graders' 
responses was 52 words. 

The breadth and diversity of texts submitted in school-based writing assess- 
ments are dependent upon the kinds of writing instruction students receive. 
The writing submitted for this school-based study indicated that participating 
students were mostly writing narrative and informative pieces. The activities 
that generated their writing rarely appeared to have provided students with a 
sense of the audiences or purposes for their writing. The assignments varied 
greatly in specificity and elaboration, as did the length of students' papers. As 
was presented in Chapter One, the median length of fourth-grade classroom- 
based papers was 84 words and of eighth-grade classroom-based papers was 
140 words. In addition, the majority of students' school-based writing was 
longer than the average of their responses to the NAEP writing assessment. 
Ninety percent of both the fourth and the eighth graders' school-based papers 
were longer than the average length of their responses to the NAEP writing 
assessment. 

Thus, school-based writing assessments yielded significantly longer texts 
and have the potential to yield a variety of text types that are written to diverse 
audiences. However, all of these features are dependent upon the amount of 
time and attention paid to writing instruction. On the other hand, NAEP 
writing assessments, and other timed writing assessments, provide a consis- 
tent view of a particular variety of student writing: writing produced in a fixed 
time period and on a specified topic 

Writing Processes In this study, we have referred to several writing 
process strategies: major revising, minor revising, prewriting, conferencing, 
and referring to sources. The NAEP writing assessment, because it occurs in a 
single sitting, does not allow for much revision, major or minor. During the 
assessment students are not able to refer to sources or to conference with 
peers or teachers. 22 One of the principal limitations of single-sitting writing 
assessments is that the writing produced essentially represents writers' first 
drafts. These methods of assessment yield little information about students' 
revision strategies. 



23 The 1992 NAEP writing assessment includes a prewriting page before each prompt, where 
students can jot down ideas, make notes, or plan their writing. 
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As was discussed earlier, for this study of classroom-based writing there 
were limitations in the kinds of information we received about students' use of 
process strategies. Therefore, this pilot study yielded little specific information 
about process strategies. In general school-based writing assessments offer 
the opportunity to collect evidence about very complex writing processes. 
Students are able to include all the prewriting, drafting, and revising that was 
involved in the production of their texts. This method has the potential to 
yield a rich array of information about the processes the writers engaged in, as 
well as the outcomes of these processes. 

Comparing Students' Performance 

A comparison was conducted of students' performance on the NAEP writing 
assessment and their school-based writing sample. As a preliminary step in 
testing for relationships between the scores students' papers received on their 
school-based writing and the NAEP writing assessment, we wanted to make 
comparisons by type of writing, under the hypothesis that students who wrote 
excellent stories in a timed assessment situation would probably write excel- 
lent stories under classroom-based writing situations. We wanted to make 
comparisons within a type of task; that is, if a student submitted an informa- 
tive piece, we wanted to compare it with the student's performance on the 
informative NAEP assessment task, and likewise for the narrative and persua- 
sive tasks. Then, if relationships were found within type of task, we would look 
for relationships between overall performance on the NAEP writing assess- 
ment and tht school-based writing samples. 

However, we faced a problem in making these comparisons. Due to the 
emphasis placed on informative and persuasive writing and the complex 
sampling design used to collect the NAEP writing assessment, none of the 
students selected for this study wrote narratives for the NAEP writing assess- 
ment In addition, very few students submitted persuasive school-based 
writing samples. Given these limitations, we elected to focus only on those 
students who submitted informative school-based writing samples and com- 
pare the scores they received on these samples with their performance on the 
NAEP informative prompts. 

The sampling design of the 1992 NAEP school-based writing study ensures 
that all three types of writing will be repi rented. In addition, we are request- 
ing multiple pieces of classroom-based writing from students in 1992 and 
asking that these samples represent several types of writing. In this way, we 
hope to be able to make more substantial comparisons of students' perform- 
ance on these two methods of writing assessment 

Because students' NAEP assessment pieces were scored on a four-point 
primary trait scale and their school-based writing on a six-point scale, we 
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grouped each scale into high and low categories to simplify and facilitate 
comparisons. On the NAEP assessment scales, scores of 1 and 2 were placed 
in the low category; 3 and 4 in the high. For students' school-based writing, 
papers that received scores of 1, 2, or 3 were grouped in the low category; 
papers with scores of 4, 5, or 6 were placed in the high category. The correla- 
tion between these two pieces of writing wa low, .16 for fourth graders and 
.06 for eighth graders. Presented below are the details on this comparison by 
grade level. 

Fourth Graders As Figure 3.1 shows, 72 percent of the fourth graders 
received a low score on both the NAEP writing assessment and their school- 
based writing. Likewise, 5 percent received a high score on both types of 
writing. However, 16 percent of the fourth graders received a low score on 
their school-based writing and a high score on the NAEP writing assessment 
Eight percent received a low score on the NAEP writing assessment, and a 
high score on their school-based writing. 



figure 3.1: Percentages of Fourth-Grade Students 



Scom m NAEP Wrfrfag Asstssflmrt 
1,2 M 



Scores m 
Writfag 



4,5,6 



72% 
N = 470 


16% 
N= 103 


8% 
N = 50 


5% 
N = 30 



•Due to rounding, percentages may not equal 100. 

Because of the high numbers of students whose writing received a score of 
1 or 2 on the NAEP writing assessment and a score of 1, 2, or 3 on the school- 
based writing, this distribution is not that informative. There appears to be an 
overall consistency between fourth graders' performance on both types of 
writing sampies — only 24 percent of the students received very different 
scores. The distribution is much different for the eighth graders, whose scores 
on both assessments v.?re more spread out over the range of score points. 

Eighth Graders As Figure 3.2 shows, 41 percent of the eighth graders 
received a low score on both the NAEP writing assessment and their school- 
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based writing. Likewise, 14 percent received a high score on both types of 
writing. However, 29 percent of the eighth graders received a low score on 
their school-based writing and a high score on the NAEP writing assessment 
and 16 perct. .t received a low score on the NAEP writing assessment and a 
high score on their school-based writing. 



Figure 3.2: Percentoge of Eighth-Grade Students* 



Scores 08 NAEP Writteg Asstsment 

1,2 M 



Scores oo 
School-tad 





41% 


29% 


1,2,3 


N = 370 


N = 258 




16% 


14% 


4,5,6 


N = 142 


N = 129 



•Due to rounding, percentages may not equal 100. 

Thus, 45 percent of the students received rather different scores on their 
NAEP writing assessment and on their school-based writing. In considering 
these comparisons, it is important to remember that, due to limitations in our 
sampling design, only a subgroup of our total participants, 723 fourth graders 
and 454 eighth graders, are represented. 

One explanation for the low levels of correlation between eighth graders' 
performance on these two methods of assessment is that the different proce- 
dures and features of the methods of assessment may result in a sampling of 
different aspects of students' writing abilities. Composing clear pieces of 
writing in response to specific prompts involves one set of writing abilities; 
composing a longer text, over several days, after consultation with others, in 
response to a general prompt or one's own ideas, provides information about a 
different, more complex set of writing processes. 

Lessons Learned 

The main purpose of this study was to conduct a preliminary exploration of 
methods for collecting, describing, and evaluating classroom-based writing on 
a large scale in preparation for a larger portfolio study as part of the 1992 
NAEP assessment. From our experiences in 1990, we learned useful lessons on 
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how to improve collection procedures that will be implemented in the 1992 
NAEP Portfolio Study. This includes giving teachers advance notice, in the fall, 
that we will be collecting student portfolios in the spring and providing 
students with folders to collect their writing. Also, students are asked to write 
a brief letter describing the pieces of writing they select and teachers are asked 
to complete a brief questionnaire describing the classroom activities that 
generated the students' writing. Hie methods developed for describing and 
evaluating students' writing will be further refined and expanded in the 1992 
NAEP Portfolio Study. 

Taking a more general view, this study allows for an examination of four 
key issues in developing new modes of assessment comparability (Does 
the assessment method offer a standard against which students' work can 
be compared?); authorship (Does the assessment method provide a means 
for establishing the author of the writing?); coverage (Does the assessment 
method provide a way for measuring a broad range of learning outcomes 
deemed important by educators and the general public?); and relevancy 
(Does the assessment method relate to the goals and methods of writing 
instruction?). 

Comparability Can a large-scale system for assessing classroom- 
based writing provide a standard means for comparing students' writing 
achievements? 

One strength of traditional methods of assessing writing, such as the NAEP 
writing assessment, is that they provide a standard means for comparing 
students' performance. By administering a common prompt or set of activities 
to students under standardized conditions, and by applying a standard set of 
evaluative criteria, these assessment methods ensure that all students have the 
same amount of time to respond to the same tasks and are given the same 
directions and information about the topic. In addition, the prompts and 
scoring guides are designed to minimize the effect students' specialized 
background knowledge might have on their performance, in order to ensure 
fairness to all students. 

Because they offer a standard, systematic means for assessing writing, 
traditional methods of writing assessment are especially useful for com- 
paring groups of students' writing performance beyond the classroom level. 
Through their day-to-day work with students, classroom teachers have 
detailed knowledge of students' abilities and achievements. They do not need a 
standard means for comparing students within their classrooms because they 
observe and evaluate their students' performance, formally or informally, 
every day. However, as soon as a teacher or school wants to compare the 
achievements of students from one classroom with those of another, the need 
for a standard method of assessment arises. While using a common writing 
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prompt, a fixed period of time, and a specific method for scoring students' 
writing may differ from students' usual school-based writing experiences, 
these controls provide a standard means for comparing students' writing 
beyond the classroom. 

A major concern about using school-based writing samples to assess stu- 
dents' performance for school, district, state, or national assessment purposes 
is that it is difficult to create the controls necessary to ensure a fair and valid 
basis of comparison. The papers that students select to place in their portfolios 
are so varied and result from such a great diversity of classroom experiences 
that the question arises, are these papers truly comparable? 

This pilot study provides an excellent example of this difficulty. For the 
purposes of this study, we classified the papers submitted into the three broad 
categories of narrative, informative, and persuasive writing. In order to de- 
velop scoring guides that could be applied to all of the papers in each category, 
we then assumed that the specific assignments teachers had given or activities 
they had designed were consistent with broader narrative, informative, or 
persuasive goals. The scoring guides were then designed to represent these 
more general, domain-specific goals. 

The scoring systems designed for this study did not take into account the 
degree to which a paper fulfilled the assignment for which it was written. For 
example, it could be argued that, as part of an ongoing writing curriculum, a 
teacher might first focus students' attention on presenting lists of information 
about a common topic. The students who submitted papers resulting from 
this activity could only receive a score of 2 (Attempted Discussion) under our 
scoring system, even though their papers completely satisfied the activities 
that generated them. 

On the other hand, students who submitted more elaborated reports could 
receive higher scores, even if their papers did not completely fulfill the assign- 
ments for which they were written. Thus, the scores assigned to papers in this 
study r2flect the types and quality of instructional activities that generated 
them, as well as the writing achievement of the students. In other words, 
portfolio assessments provide a measure of the effectiveness of both teachers 
and students. 

Authorship Can a classroom-based assessment system be developed that 
specifies and guarantees the authorship of papers submitted? 

Traditional methods of writing assessment, because their administration 
procedures are standardized, ensure that the student being tested is the 
author of the writing submitted. In a high-stakes assessment environment, 
this question of authorship becomes a major issue. For example, states that 
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retire students to pass a writing exam before graduating from high school 
(i.c, Louisiana, New York) employ standard procedures for collecting stu- 
dents' writing in order to ensure that the papers by which the students' 
abilities are being judged are truly the students' own work. It is difficult to 
ensure authorship when collecting classroom-based writing samples from 
students. 

In addition, one of the strengths of using classroom-based writing to assess 
students' achievements is that this writing is the result of the use of writing 
process strategies. A key component of the process approach to writing in- 
struction is the use of peer review and consultations with the teacher to assist 
students in revising their texts. This discussion of work with other students, 
friends, and family members provides the oral component of language use 
considered important to the development of good writing. However, this 
causes a problem when, under a classroom-based assessment program, one 
student submits papers that were the result of a group effort or a process that 
involved peer and teacher reviews and another student submits papers that 
received no reviews or assistance. Does their writing represent comparable 
efforts? Is it fair to compare the pieces they have submitted? 

Coverage Can portfolio assessment methods cover the broad range of 
writing tasks required by most assessment frameworks? 

Using a less structured approach to portfolio assessment, such as the one 
employed in this study, post.- several problems for an assessment program. A 
central goal of many assessment programs is to measure a range of students' 
writing abilities. Most writing experts and educators maintain that this in- 
volves having students write in a variety of domains (i.e., informative, narra- 
tive, persuasive), using a variety of sources of information (i.e., information 
presented in the prompt, personal experiences), and using a variety of forms of 
writing (i.e., letters, essays, stories). Assessment programs that meet this goal 
have students perform a variety of writing tasks especially designed to cover a 
range of writing abilities. 

Portfolio assessment programs that are designed to minimize the degree to 
which the assessment intrudes upon the instruction, while providing rich 
contextual information about students' writing, does not provide assessment 
coverage. Unless teachers and students were given very specific information 
about the types of pieces to include in a portfolio, it would be difficult to 
obtain the coverage necessary to meet the assessment goal of measuring a 
range of writing abilities. For example, in this study we asked teachers and 
students to select a variety of types of writing to include, yet we received very 
few papers that were not classified as either informative or narrative. Also, few 
of the papers were written to other than a general audience. 
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One solution would be to actually specify the writing activities teachers 
used to generate writing pieces for inclusion in students' portfolios. However, 
many large scale assessment programs are not in a position to specify actual 
writing activities for teachers to use as part of a portfolio assessment program. 
For example, NAEP assessments are specifically designed to monitor the 
results of instruction, not to provide instruction. Yet, for some states and 
school districts, providing exemplar instructional activities from which port- 
folio writing samples are selected may be possible. In lieu of actually specify- 
ing instructional activities, the 1992 NAEP Portfolio Study design includes 
directions to students and teachers that emphasize more strongly the need for 
entries that represent a range of types of writing. It will be interesting to see, 
with the more specific directions and the request for more pieces of writing, 
whether a wider range of types of writing is submitted in 1992. 

Relevancy Can a method for conducting a large-scale portfolio system 
be developed that allows for some standardization while maximizing its 
relevancy to instruction? 

Hie main strength of school-based methods of writing assessment is that 
the information they provide is highly relevant to instruction. Because the 
writing sampled is a result of classroom writing activities, the information 
gained about the students' strengths and weaknesses relates directly to the 
instructional goals of their classes. 

Writing is such a complex process involving many stages that it is very 
difficult, if not impossible, in a traditional, standardized setting to obtain 
measures that encompass many of the larger goals of writing instruction, such 
as peer review, use of references, and thorough use of revision processes. 
NAEP employs committees of educators and teachers to establish the goals for 
its writing assessments and to design the specific prompts that comprise the 
assessments, so that, as much as possible, the assessment will reflect current 
instructional practices. However, the need for standardized prompts, adminis- 
tration procedures, and scoring procedures necessarily distances traditional 
methods of writing assessment from the classroom. 

The tension between the needs of assessment for standardization and the 
needs of instruction for individuality creates difficulties for programs that 
employ classroom-based writing to assess students' achievements. Some 
educators avoid all forms of portfolio assessment, maintaining that the writing 
portfolio is an instructional tool, not an assessment system. They are con- 
cerned that the diversity and individuality, which are the strengths of port- 
folios, will be lost when portfolios are used for assessment purposes beyond 
the classroom. Because there is a danger that the standardization necessary 
for large-scale, high-stakes assessment programs could result in a formulaic 
use of portfolios, some educators are recommending that portfolios be adapted 



70 



73 



for assessment purposes only at the classroom or school level, rather than at 
the district or the state level. 

Sfwuuiy 

The use of classroom-based writing samples to assess students' writing 
achievement has certain strengths and weaknesses that might influence a 
school, district, or state's decision about the selection or development of large- 
scale portfolio assessment programs. 

Quality of Writing Samples First, because the time limits imposed 
under standardized testing conditions are eliminated when classroom-based 
writing is used, there are no limits to the writing students are able to submit 
Although in this study we did not often see the use of process strategies, the 
writing submitted under a classroom-based assessment system can be the 
result of complex writing processes, involving multiple revisions, the use of 
reference sources, as well as the use of peer conferencing and consultations 
with teachers. 

One result of using collection procedures that impose no time limits on 
students is longer and more developed texts. In this study, students' papers 
were much longer than the typical papers written under timed assessment 
conditions. In addition, their papers were more developed than those written 
under timed conditions. The evaluation criteria developed in this pilot study 
were designed to accommodate this higher range of writing. 

For example, a typical 25-minute NAEP prompt that asks students to 
discuss a topic and provide details supporting their discussion would assign a 
score of a four or five if a paper addressed the topic and included several 
details elaborating on the topic. For a paper to receive a 4 or 5 under the 
informative scoring guide developed in this study, it would have to not only 
include multiple details, but relate these details in some fashion that repre- 
sented more in-depth thinking and sophisticated development of the topic 
being discussed. 

Likewise, a NAEP prompt that asks students to write a story in 25 minutes 
would assign a score of a 4 or 5 to a story that was clear and had multiple 
episodes. In order to receive a score of a 4 or 5 under the narrative portfolio 
scoring guide, most of the episodes of the story would have to be developed in 
some detail. 

Thus, compared to writing produced under timed, standardized conditions, 
school-based writing yields a longer, more developed sample of students' work 
and this work is more reflective of the processes they normally engage in 
when they write for school. 
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(Mice of Writing Samples In addition, giving students and teachers 
choice about what writing sample to include in a portfolio allows them to 
select the best from among each student's efforts. Having students reread and 
reflect upon their work engages students in evaluation processes that are 
considered to be essential to their development as writers. 

The factor of choice also makes this method of assessment sensitive to 
differences in instructional programs. For example, as part of a writing in- 
struction program a teacher may have focused students' attention on narrative 
writing. If given a traditional writing assessment, these students may be asked 
to write a persuasive letter and an informative essay. While their responses to 
these prompts will reflect certain aspects of their writing achievements, they 
are not reflective of the kinds of writing they have focused on in class. Having 
students and teachers select best examples of students' writing enables them 
to select pieces that relate directly to what students have been le?^iing. 

Dependency on Instruction While one of the strengths of classroom- 
based writing is its connection to classroom instruction, from an assessment 
point of view, this connection also is a potential weakness. Because writing 
ability is considered to be a combination of a variety of skills, knowledge, and 
strategies, most measures of students' writing achievement attempt to assess 
a range of writing performance. Traditional writing assessments include 
prompts that have students write to a variety of audiences, for a variety of 
purposes, in response to a range of stimuli. As was mentioned earlier, the 
NAEP writing assessment framework calls for narrative, informative, and 
persuasive prompts that ask students to write to a range of audiences (i.e., 
their peers, teachers, politicians, newspapers) and include a range of stimuli 
(i.e., pictures, poetry, advertisements, or brief magazine articles). 

Portfolio assessment programs that use classroom-based writing samples 
have the potenti?! for presenting a range of writing, but only if the writing 
programs in which students engage involve them in a broad range of writing 
activities. Unless students and teachers are directed to include specific kinds 
of writing in the portfolio, having them select the pieces to be included in 
assessment portfolios (the method used in this study, and which will be used 
in the 1992 NAEP Portfolio Study) can result in a collection of writing that is 
limited in range. 

lb guarantee that a wide range of writing samples is collected in a portfolio, 
one would need to give teachers specific assignments or very detailed guide- 
lines about what is to be included. This approach poses problems for organiza- 
tions such as NAEP, whose mission is to design assessments that reflect the 
goals of current writing instruction and assess the impact of instruction on 
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students' achievement, not to directly influence instruction by providing 
specific classroom activities. 



Measure of Instruction A second consideration of using portfolios to 
assess students' achievements also stems from the element of choice. Under 
the collection system employed by NAEP in this study (and in the 1992 study), 
individuals decide what samples to submit in their portfolios. This results in a 
wide variety of writing being submitted. If the writing is assessed on a com- 
mon scale, specific to the domain of the writing, then the assessment may be 
as much a measure of the classroom activities and amount of time spent on 
writing instruction as of the students' achievements. 

When the assessment is located in the classroom or school, this factor does 
not pose a problem because the teacher can provide the contextual informa- 
tion about students' abilities and writing instruction to the concerned audi- 
ence (i.e., other teachers, school administrators, parents). However, when the 
assessment involves students from across a district, a state, or the nation, the 
need for efficiency in handling large amounts of information and the need to 
apply a standard scoring system to students' writing precludes the use of rich 
contextual information. The differences in students' work may be partially a 
result of the writing activities in which they engaged, the amount of time they 
had to produce the writing, and the curricular goals of the school in which 
they study. Yet, in large-scale assessment programs, they are judged on a 
common scale. Students attending schools that emphasize writing have an 
advantage over those who do not when taking any kind of writing assessment. 
However, this advantage is increased when the method for collecting samples 
of : jdents' writing is rooted in the classroom. 

To conclude, the use of classroom-based writing or writing portfolio 
systems for assessment enables us to assess writing in a way that is highly 
relevant to instruction. The length and quality of the writing submitted by 
students enables us to develop and articulate higher standards for student 
writing. It also engages students and teachers in evaluative processes that 
support the goals of the writing curriculum, ensuring that the assessment is 
an integral, meaningful part of the instructional program. 

At the same time, caution must be advised if the assessment results go 
beyond the classroom or school level. If used to assess students at the district, 
state, or national level (or for any "high stakes" purpose, such as promotion or 
graduation requirements), portfolio collection systems need to include ways of 
ensuring authorship and comparability of performance. This is especially true 
when participating teachers cannot be part of the assessment program devel- 
opment team and/or are unable to provide contextual information about 
instructional practices that would assist the assessors in making the compari- 
sons across students that are central to large-scale assessments. 
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Over the past 30 years, our understanding of what it means to be a good 
writer and how one becomes a good writer has expanded to include a variety 
of intellectual, communicative, and social processes. It seems natural, and 
necessary, that our methods for judging students' writing also expand to 
include a variety of assessment modes. From its regular, timed writing 
assessment, NAEP gains information about students' writing achievements 
on a broad range of tasks. From its special portfolio study NAEP learns infor- 
mation about students' classroom experiences and school-based writing that 
provides a context for understanding students' overall achievements. As the 
various methods for collecting classroom-based writing for assessment pur- 
poses are refined, using both portfolio and traditional modes of assessment 
in concert may provide educators with rich, detailed portraits of students' 
writing abilities. 
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Samples of Students' Writing 



The following examples illustrate the range of stories submitted by the stu- 
dents who participated in this study. The students' papers are arranged accord- 
ing to the scores they received when they were evaluated (see Chapter TWo for 
the complete scoring guide). Each set of samples is preceded by an explanation 
of how these papers fit into the corresponding category. 

1: Event Description The two papers below are examples of Event 
Descriptions. They describe a single happening, rather than a series of 
events. The second paper describes the setting of the story in some detail, yet 
only tells about one action or event Therefore, it was classified as an Event 
Description. 



PART 1: Narrative Writmg 



Example #1 (Fourth Grade) 
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Example #2 (fourth Grade) 

fir 

A mxxaM Juts Thudtt M^tK 



2: Undeveloped Story The four papers below are examples of Undevel- 
oped Stories. These stories are a series of events, but the events, as well as the 
setting and characters, are only briefly described. These stories are similar to 
front-page newspaper reports, where the basic facts of a story are reported 
(who, what, when, where) but few details are presented about why events 
happened. 

Example #1 (Fourth Grade) 

a 



a bo II 
Clint™ 




Went u/ijhh PrcTT "nc* He ufcta*o*#- 
a e Pl^fi t $ wctL tf\ >A*><" Mortice! , 

f\v\J uuokc ttjo . . 
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Example #2 (Faerth Grade) 



ShftTK'ft Cove 

One hot sumiiMir * 9u>* n*»e£ Joe was u*:Kit>» *uth three 
**cf>Is. Their uere Steven, ttiKe#*nd Terrence. They wtrt 

vczC fri*nds.Th#r talked to * cove. Terrence went down for 
uAter. All of * sudden MiKe bussed Terrene snd he feil into 
the rave. Steven uas l*u»hins,Joe tamed *r#und in timm to 
see tne Si9 c^rsml fin. He ssid to Terrence* "Get out of th* 
i4Ater |M Terrene* turned around *nd saw a SIO sh*rK« he waa 
to the ed9e of t^e cove#*nd ne veiled, "HELP! * Steven And HlKf 
rml Ibd* M Come cn! Cciae on? " then All of a sudden the shArx bit 
him. 

r no» this d*y on, Terr^ence has two »*rKS frofig the s h*rK , 



Example #3 (Eighth Grade) 
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Example #4 (BgMGrafa) 

jjmat ru^bf . 11 W Jle- ! AmeM. 

"fir / V^jLxJxt , ^ 

J&Qr- cut?- sWbULT- <Jh. , 
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3: Bask Story The four papers below are examples of Basic Stories. In 
these stories, the writers describe a series of events and go beyond a simple Sist 
of related events. Some aspect of the story (the events, the characters' goals, 
or the setting) are somewhat developed. However, these stories lack a sense of 
cohesion and completeness. They may have problems with syntax or sequenc- 
ing of events. 

Example #1 (Fourth Grade) 

One time 1 was walking down to our house When I decided to take 
a short cut. So I went down Ball park Rd. passed the softball field 
and cut through the dark gloomy woods. And passed the 
Blanchette's red barn. 1 was past David Razcek house and there 
before me stood a spooky wrecked house that I had never seen 
The address was 200 and there was no last name. The Lane was 
Dan Lane. 1 decided to leave the Old squeaky house. A few days 
later 1 got one letter from that Old wrec^ house It said, "Be 
here a 6:00 p.m. Sharp!" 1 was thinking it over vhen I thought, 
"What if it's the monster family with Freddy Crougar, Jason, and 
the Texas Chainsaw man." oo 1 said to my self, "What the heck 1 
might as well see what they're like." So I started off they weren't 
far because they were our next door neighbors 1 went up and 
knocked on the door A big man that looked like Jason answered 
the door and pulled me inside. I saw two miniature Freddy 
Orougar Jason pulled me in and sat me down on an old damp 
dusty chair and he took off his shiny mask. I covered my face 
with my hands soon after I looked out it was a regular man then 1 
remembered it was Halloween 
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Example #2 (Found Grade) 

a»riy j J /I**, AA^gr Atop> JL*UML krC^JL 

^LLmJ^JU .... 

Zonk****, jjb ' ->^<3 J 2€i^l^ _^^zi 
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Example #3 (Eighth Grade) 

Mi Hi© N<*\rQ 

dark stormy Hi9kt >&AW FnstWjr 
Krv9*r,I lUovikt 4^ wf\y . J>* ma 
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Example #4 (Eighth Grade) 



fte^ XSv ifey me Mouitd 
wiae(c) docys <f/£ Afikjns *a +k* o(£c 

roofed v€^y *ve^,T//f w»e/af /oo*s /ffa <\ 

t& td<i8Dp€ *fliey cVfof ft* vv^5 5o beau- 
and hua£,X<Kk>o -hid thenrv+O -fak^ 

W£ a fe> sauJ <K. hu*?#?cpty\*. ft looted 
^aie^d a£ <mey h& Tf vfoz so bh 

Phct ft */a* ifkt ck mfllfon OfPQ'S 
pufc -fac>pfyi*&, frs do t y$ we fit by £ iA/te 

^efff/^d^)jeessid,XVe. seen *kl 
home a^O my ^nends <\l\ 
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4: Extended Story The four papers below are examples of Extended 
Stories. In these papers, many of the events are somewhat elaborated, giving 
the sense of a sequence of distinct story episodes. Details are given about the 
setting, the characters' goals, problems to be solved, and the key events. Yet, 
these stories are confusing or incomplete. The characters' goals may be left 
unresolved, the problem posed in the story's opening never solved. The ending 
may not match the beginning or the story's ending may be inconsistent with 
the internal logic established throughout the rest of the story. 



Example #1 (Fourth Grade) 





. GbteJ. jLk&to- MrUUb, Qu 4?^"^^ 

J4^i2cMsnp~ ^ke^t^ ^$&l&6 t^JjJtcL 

- - ■ - - - 
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Example #2 (Fourth Grade) 

sumg. Muvt J%l Jiao/ wu&tit £%*>n Jtht fat smcMt 
Ma. auit Jap** u&vm cif. i^C S&ajU ettxJt 

Mum t JtwJuMp. c*J" siung, Jwi . &n4 foevx** 

porta. M&At? a/ <4ua£d -c»n*f j£Lnt4*- JtA am *Jb*na 

Jee&tJ est Jo* -4e**#, amj JKjc *J&* a* Mjl 

dh J/hX ympa/t- Tt&SSvJt&S -tjhcUivr^ ca/W* 
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/m**i ^Aj&rfkJ -X- ^ J& ^jU **rgU 

JrtUt OmJ -da**/ ^As U+fajU oaa* jHUm 2%£ 

fee chtfa* JU£h . ^Astoik. ut*Ct 

*J&r sZ$U U*»4 efytej& aJ^^&S^ 

-/*t t0 ^4^2^ e**J Jb+t ^L^t 
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Example #3 (Eighth Grade) 

Mouse hW Hfc 

tF .1 . * A ■ 1 .4. . 
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Example #4 (Eighth Grade) 



ut&+ / o<£x . e 7*&y *>fiff?« onto t-M*. 

nJlrt m. £*J *c £ A UJ^fn > " ^ CfiU ckf /of *At * >" 
@& rrneth fA£p/)«S<t SO /)€. S^r^ecL * J ^ 
yPtngof Soy e£etz<rt,i n€ eisJ siat uc f yr**a^ t 

V tfh ^i ^/Ai ic/^' i„j>* \ .»vi r ; 1^ i 



a^V- o Si send. ,r " y;c/ <dat^^ 
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£' Developed Story The four samples below illustrate the Developed 
Story. These papers describe a sequence of episodes in which almost all of the 
events and story elements are somewhat elaborated Yet, some aspect of these 
stories is not well developed, such as the ending or a crucial event 



waters of the Atlantic. But now there was nothing. Mo boat, no 
one e*cept me and some strange place that looked like an island. 

As X dragged my cold and tired tody to shore, X became 
frightened. What if tha island was inhabited by cannibals? What 
if this island was inhabited by some Satan worshipers? I could 
only dread what they would do to me. Then X caught hold of myself. 
There were no cannibals or Satan worshipers here* There was no 
sense in letting my imagination get away from me. There was only 
one thing here for sure r and that was me. 

All of a sudden my left leg hit something hard. X reached 
down to pick it up. I could hardly believe my eyes! It was the 
flag to the ship, -and it was still attached to the mast. X tried 
to drag it to shore but it was too heavy. X managed to rip the 
flag from the mast. It was the only remembrance that I had of my 
parent**, for we were separated in the accident. The flag would aake 
a good blanket for the night time too. 




Hot Mvtntttrs 



The last thing X remember was the ship sinking into the murky 
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Soon I reached shore, and I got out of the water. I figured 
the best way to dry off warn to let the sun do it for me. 2 started 
to wall along the teach. I guess X had been walking for 45 minutes 
or so. It seemed like 1 had already gone all around the island, so 
I sat down to think- Where am 1^ Will I die? These questions 
we**e flowing through my head like crazy* X got back up ami looked 
around me. But there was nothing except water and trees. I 
decided to go for the trees. 

1 entered the forest and could no longer hear the sound of the 
ocean. This was u scary place to be. X walked deeper and deeper 
into the forest where X spotted some berry bushes. X almost lost 
ay head and ate a whole hand full. Just then X remembered a trick 
X learned in girl scouts. You take the berry and put it on your 
bottom lip and after a few minutes if it does not sting, leave a 
rash, or itch it's okay to eat. I did so and to my advantage the 
berry didn't do anything negative. X ate until X was stuffed. 
Then feeling tired, I dozed off and fell into a deep sleep. 

Suddenly ! woke up. I wasn't in the woods any more. The 
surroundings looked like a hosoital. Then the pain hit me right in 
the gut. I screamed in agony* One of the masked people pushing my 
cart looked down and then l.issed mo. The person said "It will be 
alright darling. ** 

Mom - * But what was she doing here^ I thought she died on the 

Ship, 
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"Moin, why am X here"*" 

"You at* some very poisonous btrritt, * she said. 

I passed out and that's all X rtimbfr until ont day later. 

I was sitting in a hospital ted with my two parents hovering 
ovtr me. For the next few minutes my parents explained the whole 
thing to me. They had escaped the ship on a life boat. Then they 
told me how * young boy had walked out into his back yard and found 
m». As soon as he and his parents found out what X had eaten, they 
took me to the hospital whore the police located my parents. 

And to think X thought X had been on a deserted island, when X 
was really on Rhode Island off the coast of Maine. When X thought 
X had walked around the island, X had really walked only part of 
the coast line. Unfortunately this area was uninhabited. 

When X got home X hung the flag on my bedroom wail as a 
reminder of my great adventure. 
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Example #2 (Bgbth Grade) 

-The Da V of the \*v™&e M 



"Chemistry 101 . . .Chemistry 105 .Chemistry 107. Oh here it is 
Organic Chemistry. " SPLASH ! a big jug hit me as I Fell off the 
ladder. The Jug's label read " INK « " I couldn't read the rest 
because It was 3meared away. 

"Uhat was that? Are you ok? What are you doing down here' 

asked my dad. . _ . rt 

"I'm Just getting a chemistry book for my report. 

"You shouldn't have procrastinated on this report' 
Noiti you'll h.-ve to get up extra early to do it. It's late: go to 

bed* " 

mq # )( # Dad . " 

The next morning 1 was uo working on my report. My mom 
knocked on the door and came in. When she looked at my bed, her 

jaw dropped. M 
"Ken, come here 1 Erica? Erica, come here, wherever you are 
"I'm right here mom." 
No answer * 

"What's going on here? Where is she 7 " my dad asked^as he 
walked into my room, " Uh - she's 

not here," "I can't believe her running away 

from doing her report 1 Uicki, you go look downstairs: I'll look 
up here." ny dad went from room to room calling my name and 
saying, "She's m big trouble. Erica? I can't understand her. 
Erica?" 

Each time he said that I kept answering with "I - n right here. 
What are you talking about?" This was very absurd. 

neanwhile my mom called the police. -Hello, this is uicki 
Oliver. I'd like to report a missing girl. Description'' well, 
she's about five-feet-f our- inches tall, has brown hair, and 
green eyes* She's thirteen years old..." 

While Mom did that I went back into my Dad's lab. Even thogh 
my Dad's a scientist, he acts pretty stupid sometimes, n y mom 
is warm and carrying. She caes when something happens to a 
person, but my dad Just gets mad. 

I found the Jug on the Floor where I'd left it. Now the 
"INK" was gone from the label and the smudge of writing was gone 
too 1 Then it finally dawned on me. It was a bottle of 
disappearing ink! When it fell on me, it hrd made me invisible. 
Nrw all I had to da was get my dad's attention. 

I went back upstairs and heard my parents yelling "She's 
gone because of the report* That girl has got to learn not to 
procrastinate!" f , 

"No , she's run away because you're always yelling at ner* my 

mom retorted . 

-I'm never going to be the same. 1*11 be invisible torever. 
k^ot running through my mind. 

1 tried to get my mom's attention I moved pillows, slants, 
turned on the t.v,, and the lights. Finally, I took a washable 
marker and wrote on the wall: "I'm invisible. Your ink fell on 
me. Helo me! w 

Dad read it and laughed. He was sure 1 was hiding out at a 
friend's house. 

Two hours went by and he still didn't believe me. I made uo 
my mind to go to a magic store and get some reaooean^g cream. 
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I left my house at noon ami walked about a block, I was fine, 
but really hungry* I walked a long time. By the lira I reached 
main street, I thought that I would faint* 

The cars mould not stop for me because they couldn't see me, 
I Mint to the corner and pushed the walk button. Uhan the light 
changed, I went. A guy in a red sports car ran the light end 
barely missed hitting me! ! was glad when I finally reached the 
magic store. 

When 1 went inside, noticed there were a lot of customers, I 
went over to the shelf and got a bottle. Everyone was shocked 
to see a bottle in mid-air float to the back room, I opened the 
bottle, and rubbed the on the cream. 

Five minutes later I was back to normal. I yelled, "It's a 
miracle! * 

I walked out of. the stor j, and made it home safely. I 
tip-toed up the stairs, and about half way up my dad caught me, 

"Ifs about time you decided to coma home to do that report!" 

I laughed and ran up the stairs. I wworked on my report 
until my mom came in and threw her arms around me. 

-Thank goodness you* re home. I better call the police and 
let them know. 11 She walked out without aven asking me where I'd 
baen. 

Dad thinks I was at a friend's house; nom thinks 1 ran away. 
I Just let them believe that because they wouldn't understand. 
It's been two years, and they still don't know. 
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Example #3 (Bghth Grade) 



CCL8JB 'i fen Ch n i iflTWvm . 



lU>A »o .If/A rift »ft TfcuJoJtoAJa^^ — - 
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■^sti C\, »dfa&L!v?i oKa pac\ oflnfl ft/)flty<V"t.O 



URnrdt -jte-Aj -vSfc&uoa . cxnod _vSU^v^ dfliu^n Jbo _ 



.SW.u>sfeL uuup cdc ..also fVflVCXk J^wyL. 
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Example #4 (Eighth Grade) 




A *%cUr ^D°>a " r " x - 
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K2BRX WHITE 
A Modern-day Fairytale 



One 4 ay in a faraway place a a lovely lady sat in front of a window sewing* 
As she was working, she pricked her linger, end one drop of blood fell in she 
•un light* 

"How happy X would be if I had a little girl with red lips at red as blood, 
skin as tan as tan could be* and hair as black as charcoal," thought the lady 
es she sewed* 



When sussser came, her wish was granted. A little daughter was born to the lady 
and her husband- Tney nesed her Karri after her great -grandmother who, when she was 
young, was the sost beautiful woman in ths town. 
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After a few days, the lady died and 
eventually the nan sarrled again. Th* new 
wife was beautiful, but aha vu cruel and 
she waa Jealous of all the beautiful tomb 
^eOu;!J i B the land. Karri' a step-anther was 
estreeoly jealous of her. 

The step-aother 1 ! seat priied 
possession waa her T«V. She used le look 
at the T.V. and §ay f "T, V., T.V. oa the 
floor* who Is (he coolest of us all?" 

The T.V. always replied, "You are." 
One day tha T.V, said. "Why do you ask 
oe tha saae question every day? Why don't 
you ask me something like who it going to 
win the Super Bowl?" 

The stcp-»other didn't think that waa 
tunny. The neat day she asked again, "Who ia the cooleic oi then all?" 

The T,V. said, "Don Johnson. " After a long pause, it added, "X'a Just kidding." 
So the nest day the step-aother asked again and the T.V* replied, "Kerri 
White." The step-sot her knew the T.V. wasn't joking this rise - and this made her 
asd, even though she knew Kerri was beautiful and wore really cool clot has. 

The step-Bother said* "I'll have to do soaething drastic to her, but after X 
get ay hair done." So the step-aether got her hair dona and after that she told 
the chauffer to take Kerri out in the woods and shoot her. 
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The Chauffer drove JCerrl out into the woads to shoot her. Ksrri field, "What 
Are we tolng her?" 

Tta chauffer replied by saying, "I'a going to kill you: 11 Little did the 
chauffer know that Karri knew karate* so Kerri did a flying drop kick right in his 
face. He vent flying into the tree and was knocked our. 

Karri drove the car to the airport and took the firet plane. It wsa going 
to Miaai. When ahe got there* all she could do was walk the streets. That's how 
she set Don Johnson* 
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Don Johnson was flying bf the mU In HU 
Ferrari- He spotted Kerr* coning wt of Hacy's 
Deportment itcn. Sincn she mi »* beautiful, 
he stopped right at her feet. 
"Kecd « lift?* 9 asked Don, 
Kerrl Mid, "Who ars you?* 
Dost said, "Haven't you seen o» on T.V.? H 

Kerri said, "Oh, I know who you ars. Wre that person who sell* air f re ensnared 
Don Johnson Introduced himself end sold. "Co** one, get in, You're too beautiful 
to he left here!" 

Don took her to the police station end introduced her to ell hie friend*. 

Then he took her hooe to stay with hits. He warned her not to buy anything fro* 
door to door sales people. 

After e few days, the atee-aother found out where Kerri was staying. Tne stepmother 
■other dreeaed up like a tfitl Scout leader and want to the house to sell cookies. 
She had put poison on some of the cookie* . She knocked on the door. 

Herri anewsred. "Who is U? n 

The atep^othar said, "It's only a Girl Scout leader who la selling cookiee." 
So Kerri opened the door and the lady said, "Would you like eos*r 
Karri asked, "Do they have altsonds in then?" 

The step-ewther said, ,r Y«a, they aure do t and they taste good, too" as she popped 
one in her aowth end began winching away. She had accidentally eaten one of the 
poisoned cookies and she fell to the floor, not tsoving- Kerri called aose of the 
police*** to help her. but by the else they had arrived the step-not her used her 
aaglc powers to make herself cone beck to life, and had escaped by way of the 
back door. 



104 BEST COPY AVAILABLE ice 



Vheo ten Johnion got heme, he eeid, n l Juet remembered X forgot to eey something 
this morning 2 H 

Kerri eeld, "What dU you forget to wy? M 

Don answered by ■ ay log, "I say it ovary morning bafore I go to work. X say, 
X 1 * rich, I'm rich T it's off to vork ! go. X own a pool, X own a hoot, I'm rich, 
Vm rich." 

"Xom aUo forgot to toll so there wee en alligator in your swimming pool! 
Xt »;nvtl«d me when X wee trying to get e aunt en. He juet popped up out of the water," 

The next day the step-mother came egeln, dreeeed ee en Avon Lady. She 
knocked on the door. 

Herri eaid, "Who is lt? H 

The lady said, "U'f juet en Avon Lady/* 

Karri opened the door. Thie time the lady was selling perfuse. 
Kerri asked, "May X amell it?' 1 
the ledy teid, "Sure." 



Kerri took one whiff of the perfume end fell to the floor because the perfume 
wee poisoned. In her hurry to get away, the step-mother dropped her hand lotion and 
•pilled it ell over the floor* 




I 





Don arrived hoee a fev seconds later and saw Kerri lying on the floor. He 
heard a noise and looked up in time to see the svepaother trying to escape frow 
the condo t by walking quietly out the back door. She slipped on her hand lotion 
and slid into tfc- pool right on top of Don's alligator. That vaa the end of her 

Don leaned over to give Herri a farewell kiss, and suddenly aha opened her 

eyes. 

Karri and Don got married and drove off into the sunset in Don's Ferrari. 
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fir Elaborated Story No papers were considered to be Elaborated 
Stories, lb be classified as elaborated, these stories had to present a sequence 
of episodes in which almost all of the events and story elements were well 
developed. Goals or problems introduced in the beginning were well resolved 
by the end; characters' motives were well developed; and the entire story was a 
cohesive, unified whole. 
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PAW 2: Informative Writing 

The following examples illustrate the range of informative writing submitted 
by the students who participated in this study. The students' papers are 
arranged according to the scores they received when they were evaluated (see 
Chapter Two for the complete scoring guide). Each set of samples is preceded 
by an explanation of how these papers fit into the corresponding category. 

I: Listing The two papers below are examples of Listing. The writers 
present pieces of information or ideas all en the same topic. These papers may 
also contain a range of information about the topics. However, no attempt is 
made to relate the ideas or information. 

Example #1 (Fourth Grade) 
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Example #2 (Fourth Grade) 

"U*v«_ Ca^- 4***"^ a^ujKxmaAi:, ' A^JUjcJb^ w, -^o jt&t LJucJt cvwi m *S* 

^^^^ ^V'^^^ 

A*ti>- cuvC UJU. Ar.. , , ^ :^uy; 
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Lilil^f Mfussion The four papers below are examples of 
Attempted IWsiom. A range of information and/or ideas about a topic is 
Presented in these papers. Also, in one part of each oarer JTh!^ 

re ^° mhips « «* dMri * Wished. The ideas or ntrma- 
tion may be incomplete or undeveloped. 'nrorma- 

Exnapk #1 (Fourth Grade) 




c<tc/r i s 



*iXw, Mtuet., j^M-c^ -W dtui*Jj&. shA. 
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Example #2 (Fourth Grade) 



? He <dU^. 






He oJbxsh (xJ^rni^a^ 0^ 
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Q ™ L UJ ^y- ^ ^VoA 

mxxr^v^oA^ , SW^. Okus bi*)h Jhoa^ r>^m 
pa^no^o , ^i/rJUl^ , bcsdOn Axx,^ JhtUn , 
<SW di^svarru^ J>o c^.cyi ^xu^ 

^Vty >KU^ JboJlXD , WflkAJfOHn, uuu 

^ ' ^nouiMt j^Wsli* cr©s*o. , w 

^rviuj Atory. rruaa»a . ^U^cdiy y daqa 
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Example #4 (Eighth Grade) 



Hit I L&rripjrowti. , (J* hf> (Ju~ r *~ lrr * 
^Ojr-e^miM Us«.*ut tio««t. fo*r^g» . 

Vxxre ci'Stsro^ SWvp^S 

00^ ag^s CV£c^ -b^ert uoc»\k\6 
\>e os.^ iC&s t^c£* 

^^AissvoG oXc^, 

U&U. TOc ^"NV^VS'TMi JIOU. 
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oc .oVits* .-La b^sL^>uciiL, 

-^Wja&e CO We Ovrxi 
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3: Undeveloped Discussion The four papers below are examples of 
Undeveloped Discussions. These papers r hide a broad range of information 
about their topics. Relationships are somewhat established between the ideas 
and/or information, but not completely. The ideas may be confused, contradic- 
tory, out of sequence, illogical, or undeveloped. 

Example #1 {Fourth Grade) 




Example #2 (Fourth Grade) 

an 



uAZs aybbttjiAj Ann Jrct L, 



^ Win/ uc 

filMi fizr. flt jMoU. ^J- 
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Exrapfe #3 (Eighth Grata) 

AAi • ■ Q ij(u)8^ wtooA Ju \^Uoj^ 



118 l20 



-J^fLCdjJt^A ,d2c/l/ft /fo/nUL4Ltt 

rmAsrua &tfajL fSB&f&i,. 
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Example #4 (Eighth Grade) 



4JKqO£ r<a?Wt Ji>€ nerve 'Jh *ha nuprrircng-ri 
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4: Discussion The four papers below are examples o' Discussions. In 
these papers, a broad range of information and/or ideas is presented. In at least 
one section ^the writers use rhetorical devices (such as temporal order, classi- 
fication, definition, comparison/contrast, cause and effect, problem/solution, 
goals/resolutions, predictions, speculations, drawing conclusions, point of 
InTkw"* "* ' mp0rtance ' otem P |ificati on) '<> clearly relate the information 

Example #1 (Fourth Grade) 
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Example #2 (fourth Grab) 



/U^y^^xj^ A/laa^^JX^ MACa&CAtA .... 

^f^J^y- ^(^^ 

- y TO" 

-u*t Jl -/^Cou^, QJLfvdU M^d* 
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Example #3 (Bghth Grade) 



Pmr» 1 

"My Brother" 

I have a brother his name is Heath, he is eight years old. 
Heath has light brown hair, giant brown eyes, wear* nbron glasses 
with a little neon yellow band that goes around thtc Me is about 
5 foot tail, very skinny, and very strong for his age. 
Interview On Paul Revere "Paul, now that the 

Revolutionary War is over, could you please answer a couple of 
questions for me?" -Yes, l f d be happy to. " 

"I'd like to know what your profession was before the war?" 
"Back in Boston * was a silversmith. " 
"Since you Mentioned Boston did you have anything to do with 
the Boston Tea Party?" 

N Ves, eyself and a group of patriots had taken part in the 
Boston Tea Party* * 

"Paul, what was the pour pose of the Boston Tea Party? 9 * 
"It was a warning that the colonists would refuse to pay 
taxes unless they had toat share in their own government." 

"Paul, what was the midnight ride all about, and what role 
did you play in it?" 

"The midnight ride was soposed to inform the minutemen 
;hey march by land or go by water. I had to wait night 
.*r night for a signal saying weather to march by land or go by 
water, then X would ride by horse spreading the news. " 

"I thank you for speanding your time here to talk to 
" "Your welcome, I enjoyed being here 

talking to you. * 

Xnterveiw bys 
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Example #4 (Bgbtb Grade) 
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5: Partially Developed Discussion The two papers below are examples 
of Partially Developed Discussions. These papers include a broad range of 
information. Information and relationships are established and well developed, 
with explanations and supporting details. The paragraphs tend to be unified 
and well formed. However, the paper lacks an overriding sense of purpose, 
audience, and cohesion. The writers of these papers present a wide range of 
information on a topic organize this information dearly, develop most of the 
aspects of this topic, yet do not place their discussion in context, within a 
wider communicative purpose. 



Example #1 (Fourth Grade) 



^C^^fl^w jl^cC ru^x^x^ Ama^C 
d-A&VL USUI, *X42^s*^£*dLls ^Lct Jlt£<*^<- ^l*^ 
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Example #2 (Eighth Grade) 
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&• Developed Discussion No papers were considered to be Developed 
Discussions. For papers to be placed in this category, they had to contain all 
the elements of the previous category, plus present a coherent sense of pur- 
pose and audience. These papers would contained an overt use of organiza- 
tional structure and demonstrate excellent command of the conventions of 
written English. 
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PART 3: Persoosive Writing 

The following examples illustrate the range of persuasive writing submitted by 
the students who participated in this study. The students' papers are arranged 
according to the scores they received when they were evaluated (see Chapter 
TWo for the complete scoring guides). Each set of samples is preceded by an 
explanation of how these papers fit into the corresponding category. 

1- Opinion The paper below is an example of an Opinion. In this paper, 
the writer asserts an opinion, but does not develop or explain this opinion in 
any detail. In Opinion papers reasons sometimes are given to support the 
opinion, but these reasons are unrelated to the opinion or contradict one 
another. 

Example #1 (Fourth Grade) 
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2: Extended Opinion The four papers below are examples of Extended 
Opinions. These papers include a statement of opinion and reasons to support 
the opinion. However, the reasons are only briefly presented or the explana- 
tions are confusing. 

Example #1 (Fourth Grade) 

In my opinion smoking is bad for 
you. because it causes problems like 
tuhen people get covered with smoke 
thet smell like smoke. Ulhen people 
leave a room because of the smoke. 
Smoke polution is caused by smoking 
too. It harms your heath too. It 
causes your lungs to turn black. It 
puts holes in your air sacs. You get 
less oxygen. You get cancer. Here's 
Just a feui things that could happen 
if you smoke. So don't Smoke. 
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Example #2 (Fourth Grade) 




and rvV\Ke_ aou a^a-EJu, 
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Example #4 (Bgbth Grade) 
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3: Partially Developed Argument The four papers below are examples 
of Partially Developed Arguments. These papers include an opinion statement 
and clear reasons to support the opinion. They also contain attempts to 
develop the opinion with further explanation. However, the explanations given 
are not developed or elaborated. These papers may also contain an implicit 
reference to the opposing point of view. 



Example #1 (Bohtb Grade) 



Governor Wa^cc i6 'thinkina abotfl le>t-fina 
^©rkina <panerrb -fate +ime off trcm u)ork 

X don ,- r +hi"nk "6 a g^c?^ <<*ea *or cjorklna 
parents +o come, +a schooi btcaaoe they 
havt +o go +o ujork md W 0#?er -f b/ngs 

If o+her <peo<pkb fpartntb comt jo dchoo I 
I^ouldW m\nd a*> mudi ba+ £>iill udT 
it 1 aoT in -rnoabie and mu berf \Q&nJ$ 
farerrb uoert here, -they rmdn think Tm 
(xhack »nilufinc£ and nc"f /e+ "M>«ir fc<rf 
CGM&to haute or rr?e cec 

I uxjcddnt ojani myfacaitzj come, +0 
mu school because* Ic^//t" neof- or 
do pqttiHhinq the, or mu rnom or dad 'Jouw 
scold rr*e> ond Bmbtirrz?* 
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Example #2 (Eighth Grade) 

haue -to mate up -svno^ da>^ 

Fir^-V of ail \\ Lo 4V\C la^o 4Vx^ 
toe pp l^O dav;^ o- ^cncd a 

as arv d-l^r icxlo, -sue POL -hbf&c 
eocx^ -for -VKj2 stuci^^ cduan^a^f , 

V\/we -for \QD^n\Ag«TV^w 
4K*V q3ar* iV^j convict miss 

bXDua^ 4ne^| die* n€4 g&^maat- 
-foor. 
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Example #3 (Eighth Grade) 

" Look mom, I know you dont want me to have a sling- 
shot, but think of all the wonderful things I could do with 
it 1 There are tons of reasons why I should be able to have 
one. Mere are just some of the reasons. 

For cie thing, I would be able to keep the neighboors 
cats away from the birds in the bird house? X know you'd 
hate it if those cats got in there and actually ATE one! 

Another reason is at Christinas time, X could go out 
and kill maybe a squirrel and make an ornament out of him 1 
I know you spend alot of money on Christmas decorations 
everv year . 

And most important! y f I feel that you shoul d 1 et me 
have a slingshot because I am on top of everything. I' m 
doing well in school , been doing my homework, and for the 
past week, I've been babv-sitting mv little brother! 

I deserve a si mgshot ! M 
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Example #4 (BgM Grade) 
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4: Developed Argument The four papers below are examples of Devel- 
oped Arguments. In these papers, the writers state their opinions with reasons 
to support their opinions. They also include at least one explanation that is 
well developed. Rhetorical devices (such as sequence of events, comparison/ 
contrast, problem/solution, and classification) may be used to develop the 
explanation. These papers may also contain a brief summary of the opposite 
point of view. 

Example #1 (Bghth Grade) 



Ssfcj* ^*^-..j£££xWBue 



Vt^iter ^.e^^vc iuA^ JSkSt^M 
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Example #2 (Eighth Grade) 



Dear Editor, 

I feel that the school lunches are very distasteful and 
to worsen the problem, some of the cafeteria workers Are 
discourteous and impolite. With the addition of long Mnes, 
it just isn't worthwhile to eat at our school cafeteria. 

Many of the meals they serve us are unappealing and are 
made with such a low grade of food that they are not 
healthy. Also, sometimes the food is either cold or too hot 
to eat . 

Many of the cafeteria workers make feeing even more 
unpleasant. Some of them tend to have an unfriendly 
att 1 tude . Whenever thev give i nst rue t ions , they hoi 1 er st 
you instead of kindly asking. 

To improve the school lunches, I suggest that the 
school should buy a higher grade of food and try to fi 1 * the 
meals more to the student body's liking. Maybe the school 
can also serve a mixture of dishes so that each student can 
pick the food of their choice. I know that changes will 
cost money, but it is time to make changes and T'm sure most 
of the students would be Willing to spend a little more to 
have a better lunch. 
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Example #3 (Dgkth Grade) 



Shoo*. 
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Exsnple #4 (Eighth Grade) 

^yi^M^Jtkd^ qjt tfft 
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&* Partially Developed Refutation In order to be classified as Partially 
Developed Refutations, papers had to include a clear opinion statement, with 
reasons to support the opinion, and elaborated explanations. These papers also 
should contain an adequate summary of the opposite point of view and may 
include some attempt to discuss this opposing position. No papers submitted 
fit into this category. 

Developed Refutation For papers to be considered Developed Refuta- 
tions, they had to contain opinion statements, reasons to support the opinion, 
explanations of these reasons, plus a discussion and/or refutation of the 
opposing point of view. The refutation must be clear and explicit, including a 
discussion of why the opposing viewpoint is limited or incorrect No papers 
submitted fit into this category. 
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PART 4: Poems 

The following examples illustrate the poems that were submitted. The first 
four examples were written by fourth graders; the last three by eighth graders. 

Example #1 (Fourth Grade) 




./X^&fHohjU. 

^ - 
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Example #2 (Fow* Grade) 

*Where Does JhW 
Sfe Y End?' 

CUWr^- doe^ s\cy end? 

Qo depend 

0\n God - oun 4rie<^c/ 

To a§ ^ 

CJh*jr<L The sky eoc/^: 

0<~ \sV»ou|c\ coe oaly 

On. V -Ply 

TV>e^<? g <zv°n rv r.y 

4Je . are -hyi^ -h> 4-ly 
X Vyafe X do. : elefaanJ 

\Hr*) do . nor o*feos/ 

Oui^ Goci ^ A dL 2^ Tptrx] 
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Example #3 (Fourth Grade) 

2)e aSiL (&v«^. 4j\ju., A***^ a- JU^t 

;0 ©^to. Rjo^~ r-oo&vj-^ LMi^ 
cx^tsA ae-t^ -cu^d: I . 

#A ^ <v«^ <*f^£. t WtM 
x3U J2rt^v Xn^j 
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Example #4 (Fourth Grade) 



UrozrC JaaLft^ 
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Exonple #5 (Bgbth Grade) 



II 

X <xrr> a. hi, man toa» Vs k> fee an an.'ma/* 

X Vs<.ac human mind* u-'^rK, 
X set rviySel-C l^C o. bird, 

X~XWvV +© 1-Vxt UitfV 3 round Cor my Oton, 

X Ok.»v> a^um arv "HujiV wants "to fee an *ru't»*L 

X pre-Wnd +V\aV X <xn-> ^ty*^ i 
X rn\j ^ur vSfiepu^ <v\£ toAr^i 

Xi^rrv, about o^y fetW- ftt«Vrf* W + K eir ^cm£s h«u* 
X ar^ ^cr i-ic^t.W&ii brc*^« rI >i 



X c-.xitc 5»1af<i Oct etc\o a ioU prefers, 
X sc^ t M ue> o«r bickers aWne", 

Xdfea,vxc^ reaming buC£n.\o of &o.m«Mflj -^h< 
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Eranpb #6 (Eighth Grab) 



"Ike. Dinotaui" 

It* t tnxie, I mitted the &ut. 
fly mom' a to mad, the' t ttanting to cutt. 
She pickt me up in a lemon o£ a cast, 
I'm thinking aJLout an entny on a dinotawt, 
Uhen all ojL a Midden, the can ttopt, 
And the /uadio' t ttili tinging HefLopt* 
flom caULt Dad ptom wonk. 
AfJLeA. that, the ttiet the can. again, and it 
ttantt with a jenk. 
li/hen flom gett tack. 
To the houte, 

She' 11 hang hesi coat on the /tack, 
Talk to heA tpoute, when he gett 
Home. 

She'll ttand up (at tall at a gnome), 

And yell and yell yell 

Then mayHe the houte fLell 



1B5 



Example #7 (Eighth Grade) 




W£jjiL mc JUou) op^U Jk&uZy oa 
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PART 5: Letters 

The following examples illustrate the letters that were submitted, but could 
not be classified as informative or persuasive. The first five were written by 
fourth graders; the last two by eighth graders. 

Example #1 (Fourth Grade) 

Mm duif ctzaJk^A/ j#u jtui J^o uts& 
ccxdd. h<x<>t $uact J/n, Jkib M/Otidj 
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Example #2 (Fourth Grade) 





surf AiA*} *+ k&dJ*. **** 

rtHlLA. h£ ULu Cffasjs 

tfi^i^Jtf jCUltblAUy aft £^^r 



73, Ml*f dvCt you. aor 

Zero} ] wf4JJL i^^fu 
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ExoBfb 413 (Fovrth Grade) 

.U& stflSL sd&^A&v^ -^olOM^. 




Example #4 (Fourth Grade) 

W SO U/juJ- ZL7^A 




y 



A <tfr u t, *<dfc**^. MxsUs' 
!?ruibr slower^ -jzccA -^&r 
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Example #5 (Fourth Grade) 

Jeff /ri&ort Susn^- 3 aaM^ Au^^'^^ 
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Exonpb #6 (Eighth Grab) 

Deo* bu^j 

Co**** Ki-U ejvui^ "Duxc5> Jt c-uJt , ^ £ cjct< 
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ExM|fc*7(BgMGradt) 

>ut>\iewfcer %l>m<\ 

///.' Srfkze. iPs a Ion 3 X haver)>+ ^ph. 
uom a«u letfer. ^vJ X am hoptnj ^yoq 
are nor mad 0+ to e. As uom **ou; y X don'r 

Xsn, fo ^e// gou f/fe X ^ealjv. w*^ 

Florida, ^en, h&^> is sdioof ? 
Are mou tav/i>w rec^ nouJ./vfejou 
s-hHqOMQ <b MS.L Ms? 

-f^rn -fiie 6eg<fl{no o-P +ms letter, 
ro»7 jas^ askitlQ cjou ^Ujpy^uT neuer tell 

[s ojtau . <oarw.x fie, *fk«. sJW £>o,x 



Aiav/e a JOT or -tnenco ^ • ~« ' -* 

V-he -ttws.rlu trfe, is u&y boring- 
yen, Jr cf6n"r *«o<~> uiha^ 
2: /Jeue^ -forged ~fo ojisJi uou 
briqh + {\)4or£ /$ woj"(i«o tor 



yen, J~ dfon'T A^o^J A>jKa^ -to s<ay ■ W 

wnun- _ «9°^bryOU. 

WAs'iflif u^u're. doino good ji>b inscutlj 
M&h Vou J Wt a Ver*Y f*aiM Ufa - 
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PART 6; Re sea r ch Reports 

The following research paper, "Hie History of the White House," is typical of 
the several research reports that were submitted. This paper was written by an 
eighth grader. Some of the other topics of research reports were: Abraham 
Lincoln, Watergate, and World War II in the Pacific. 

The History of the 

White House 




TABLE OF CONTENTS 
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Bibliography 15 
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November 2, 1800, President John Adams, moved into the White 
Bouse. Ever since that day, each president has lived there 
during his tern. It also houses a number of mdmiaistation 
offices. over the years, the white Bouaa has become a greet 
symbol of the executive branch of the united stetes. It has also 
becone one of the world-wide symbols of Democracy. 
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Chapter X 



construction of the White House 



In 1791, United States Congress was looking for a permanent 
borne for the federal government. 1 They decided to build a 
capital city along tbe Potomac River. Tbey also needed a 
President's Mansion in tbe capital* 

Congress offered $500.00 to any arobitect who could design 
tbe beat President's Mansion. An Xrisb-born architect named 
James Hoban and eighteen other architects sent in their plans for 
the perfect president's Mansion. 2 

President George Washington looked over all the plans and 
decided that Hoban 'a would be the best, even though congress 
requested that tbe porch and wings of the Hoban * s plans be 
deleted. 

Zn July of 1792 , tbe commissioner invited James Hoban to the 
Federal City (soon to be called Washington, D.C. ) » when he 
arrived there, he saw that tbe "city" was nothing sore than a 
swamp. 

On October 12, 1792, the first cornerstone of tbe mansion 
was laid. It was the first government building to be started in 
the city. Hoban figured that they had eight more years to build 
the mansion. But congress were running low on money, and 
materials were hard to get. 

President John Adams and his wife Abigail were ready to move 

in, even though only six rooms were ready for occupancy; but tbey 
moved in anyway. 
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chapter XI 

Living in the Whit* House 

Abigail Adams moved into the mansion on the night of 
November X6, 1800. President John Adams moved in two weeks 
earlier, whan she got there, aba won laarnad about all tba 
inconveniences of living in tha unf iniabad mansion; however, sba 
was plaasad with tha mansion daspita tha many problems 

prasidant Adams dacidad to land dignity to tba new white 
mansion. Ha called it tba "President's Palace". On Mew Years 
Day, 1801, the President Adams held the first formal reception in 
Abigail's upstairs oval room. 

Tha next President to serve his term and move into the White 
Bouse was Thomas Jefferson. Since the mansion can only be 
occupied by the President in office, Ex~presiden* Adams had to 
move out. Jefferson did not believe that the President should 
live in a palace; he merely called it the "Presidents House". 

Since the "President's House" was not yet finished, he took 
great pride ia finishing and furnishing many of the rooms in it. 
He added a porch and low colonnades. He added East and West 
Terraces to the growing mansion. 

Also, he furnished the State oval room quite elegantly. Ha 
used it to meet important dignitaries. It is called the Blue 
Room. He chose not to finish the East Room. Instead, he used it 
as an extra pantry. President Jefferson did most of his formal 
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entertaining i» tba two parlors on either side of the Blue Room. 
These rooms vara named af tor the colora moat usad in them, Tba 
room decorated in rod la callad the Rod Room, and tba room 
daeormtad in green ia oallad tba Graaa Room. 

Bafora Jaf Carson moved into tba capital city, it was a bog. 
But ba mada it fit for carriages and bad poplar traas planted 
along tba streets. 

Tba naxt president and bis vif a to liva in tba White bousa 
vara James and Dolly Madison. Dolly bad many gay parties in tbe 
President's House When Congrass granted money for furniture, 
Dolly Bought mirrors to brighten up tba mane ion. 
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Chapter ZZZ 



The Burning of the White Bouaa 

Zn 18X4/ tha united Statee was at war with England in the 
War of 1812. Part of thia time, Preeident Madison vaa away, 
laaving Doily alon« in tba Wbita Bouaa. Zt van then, that word 
bad apraad that tba Britiab wara ooning to Washington. Dolly 
carefully paekad aona important atata papara and a larga portrait 
of Oaorga waahington takan from tba frame and biddan. Than Dolly 
disguised baraalf aa a poor faraar'a vife, antarad a waiting 
ataga coach, and flad to aafaty. 

That night tba Bti* ah bursad avary government building to 
tba ground, including tba whita Bouaa. Tba naxt day, tba only 
structure laft of tha mansion vara tba four blackened outaida 
walls. Mr. Boban vaa again called back to rebuild tba Wbita 
House. The nanaion vaa finally rebuilt and tba vella ware again 
whita. 

president Monroe was tha new Preaident Zt coat ao much to 
rebuild and reatore tba bouaa that Congreea bad barely any woney 
for furniture. Monroe offered to sell bis ovn furniture to raise 
more money. with thia money. Congress bought elegant Prench 
furniture for tba mansion, some of vhieh is still being used in 
tba white Bouse today. 
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Chapter XV 



Changes in the White House 

President Monroe liked to live vary tonally. After the 
firm, he redid tha White Bouaa to auit bis taste. Ha alao 
preferred to call the mansion the "Executive Mansion". Evan 
though ha call ad it tha Executive Mansion, everyone alaa oallad 
it juat tha Whita Bouse* 

Jackson waa tha next president. Ha made many important 
changes in tha White Bouse. Ha had vater pipad into tha mansion, 
making it no longer aaoaaaary to carry it in by band* Ha addad 
tha North Porch, or portico. This gava tba Whita Bouaa tba 
addraaa 16 oo Panaaylvania Avenue. "This antranca shall ba used 
only by kings , quaons and vary important people," Jackson 
announcad . 5 This custom is still obaarvad today* 

Jaekaon alao finished tha East Room. It bacama tba formal 
raeaption room, but it vas also usad as a play room for tba 
childran of tha Whita Bouaa. Gradually, tba 18 acras of tba 
Whita Bouaa vara drained, and gardans vara planted there. Gas 
lights vara installed in tha mansion in tba 1840 9 a. 

in 1850 praaidant Fillmore made haadlinaa whan ba bad tba 
first bathtub in tba White House ina tailed. People vere 
concerned because they considered tub bathing dangerous* Be also 
bvugfct a cookatova for tha kitchen, but tbe cook refused to uss 
it because she fslt comfortable vith the big fireplace uaed up 
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to this tims. bo Prssideat Fillmoro himself lsaraed how to us. 
the stove sad tbea taught tho cook. 

JCeaawhile, Hrs. Fillmore, being • teacher, realised that 
thoro were bo books 1b tho maneioB- not evea • dictioaaryl with 
the BOB07 coagreea grant ad for Books, Mrs. Fillmore selected tko 
first books for the wkits Houss Library. 

Wbsa Chostor Arthur booaao Pros id ant, bo rofusod to move in 
uati? everything was refuraished sad rsdsooratsd. Ho bad tweaty- 
four wagon- loads of furaituro sold at aa auction. Today, tbo 
government baa a law prohibiting such a procedure, all furaituro 
not wantod must by law ba saat to tbo saithsoBiaa Institution. 

As tho country grow and ehaagad so did tho mansion. 
Tolepbonos wars installed. Electricity took tho placo of gaa. 

whan Theodore Roossvslt booaao Praaidaat, tna houso was 
beconiag too small for a larga family aad a growing staff. Also 
tbo prssidant was informed by anginaars that tha foundations wars 
woak. congross agraad that after one hundred years, tha house 
seeded extensive renovation. 

Tha Roosevelts had to temporarily aove out of the mansion, 
so that the engineers, paintara, aad carpenters could do their 
jobs. Ihsy put steel beams in ths basemeBt to support the 
mansion and elongated the dining room to seat obo hundred people. 
A wing waa added for presWsnt officss, and the second floor was 
made into a private home for the Presidsnt aad his family. They 
alao added a wing for tho offices of ths presideat. 

"Let's change the name officially to the White Houss," 
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Roosevelt said to Congress. "That's what everyone calls it 
anyway, "* IB 1908, Congreos paesed a lav making the "White 
Hons** the official title of the mansion. 

With tba White House fully renovated, it eventually still 
saamad too small; President Coolidgo addto a third floor, which 
provided extra bedrooms and needed storage apace, in the 1930 9 s 
President Roosevelt added a swimming pool. 

Along with the reet of the country, during world War IX, 
precautions were taken to protect the White House. Black-out 
curtains were installed, underground offices and bomb shslters 
were built, and sacbina guns were sounted on the roof. 

During President Harry Truman's tern in office in 1948, he 
wee alerted to the alarming possibilty that the building might 
eollapes at any moment. It seems that over the many years of 
changes in pipes and electrical wiring, and the wear and tear 
caused by the thousands of sight-sears who toured through the 
White House, the building was under too great a strain. 

At first, serious thought vas given to tearing down the 
place and building a modern new White House, but ths American 
people wanted their original mansion preserved. It was finally 
decided to dismantle each room carefully and to rebuild juet as 
close as possible to its original design. It waa a tremendous 
job. The architects used the basic plans made by Jama a Hoban. 
They added a strong foundation that could withstand ths heavy 
traffic, congraea gladly granted the nearly 6 million dollars, 
which was a very large sum during that period of time. 

During President John F. Kennedy's presidency, Mrs. Kennedy 
reetored and added many beautiful furnishings and valuable art 
work to make the White House a showcase of the country. 
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Cbapter V 



Tbe Whit* Bouae Today 



Today tbe wbite Houaa baa become tbe moat famous bouse in 
tba world. Millions tour it aach yaar. 

Tha Wbite Houaa itaelf ia aurroundad by id aoraa o£ 
baautiful garden aeanary. it baa traaa, flowera, and a grant 
lawn callad tba Preaidenfa park. 5 Tbera ara now 132 roome in 
tba Wbita Houaa. Tbara ara 323 pamanant ataff working in tba 
wbita Houaa. 6 

Tba Eaat wing of tba Wbita Houaa serves aa a public 
entrance, and bouaaa many offieas for tba Praaidant»a ataff. Tba 
public rooma of tba Wbita Houaa ara usad for waddings, partiaa, 
and otbar aoeial agents. Examples of tbasa rooms ara tba Rod 
SUVO0, Oraaa Roon, Blua Room, and tba Eaat Rooa. Tba Eaat Rooai ia 
uaad to display caskats of tba Preaidanta wbo bava diad during 
tbair tarn lika Lincoln, Kennedy, ate. 7 

Tba Executive Wing of tba bousa ia wbara tba offices of tba 
Praaidant and otbar govarnnant officials ara located. Tba Oval 
Office, wbicb ia tba Praaidant* s office, waa added in 1934 by 
President Roosevelt. Tbe top two floors of tbe Wbite Bouea ara 
tbe official living quarters off tba President *nd bis family. 

in tba waat Terrace of tbe Wbite Bouaa ia tba family's 
private movie tbeater. Tbe indoor swimming pool is located in 
tbe Beat Terrace. Above tbat area are tbe Wbite Bouse preaa 
facilitiaa, wbere preeidential speecbea ara televised via 
satellite all over tbe world. 8 
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Chaptsr VI 
Ghosts in ttas Whits Beuss? 

Sobs psopls elaia thsy bars sssb s ghost ia ths Whits Boussl 
wsll-knovn psopls lihs Winston Churchill and Princess Ju liana* of 
ths Hsthsr lands elaia that thsy had sssn Lincoln* s ghost is his 
bsdroea at ths whits Bouss. 9 

Also msabsrs of ths Rsagaa family elaia that thsy had sssn 
him. Whsn Naurssn Rsagan and hsr husband, slspt in ths 
Lincoln's Bsdrooa, thsy ssid thsy havs sapsrisnosd ths prsssnes 
of Lincoln's spirit. Prssidsnt Rsagan and nancy Rsagan rsfussd 
to hs spooks* by Lincoln's ghost, but "thsrs is oss othsr asabsr 
of ths First Faaily who bsllsvsa. nancy Reagan says Rsa, ths 
faaily dog, oftsn barks at ths Lincoln Bsdrooa door, but rsfusss 
to go in." 10 
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As our country has grown sad natured, so baa the waits Houss 
rsflootsd all tbeee changes aad inprovsaeata. This mansion is 
not just ths living aad working quartsrs of our Frasideata, but 
alao aa important aynbol of our Aaericaa heritage. Ssch 
Presidsat has left his max*, good or had, during his tern of 
offiea. The people of our country over the yesra have developed 
a deep love and pride for our great growing aad changing White 
Houae. 
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Appendix 



Appendix A: Demographic Characteristics of the 
School-Based Writing Study Participants 



This report contains results for groups of students within the nation defined 
by certain demographic characteristics. The definitions for subgroups, used in 
all NAEP assessments, as defined by gender, race/ethnicity, parents' education 
level, geographic region, and type of community follows. 

Gcador. Results are reported separately for males and females. Gender was 
reported by the student. 

Rote/Etfaldty. Results are presented for students of different racial/ethnic 
groups according to the following mutually exclusive categories: White, 
Black, Hispanic, Asian/Pacific Islander, and American Indian (including 
Alaskan Native). Some racial/ethnic results are not reported separately be- 
cause there were too few students in the classification. However, the data for 
all students, regardless of whether their racial/ethnic group was reported 
separately, were included in computing the overall results. 

Prats' NkoMm UteL Students were asked to indicate the extent of school- 
ing for each of their parents — did not finish high school, graduated from 
high school, had some education after high school, or graduated from college. 
The response indicating the higher level of education for either parent was 
selected for reporting. 

GtograoJfc Region. The United States has been divided into four regions: 
Northeast, Southeast, Central, and West 

Type of Cuo— oily Results are provided for three mutually exclusive commu- 
nity types — advantaged urban, disadvantaged urban, and extreme rural — 
areas that typically reveal differences in students' performance. The definitions 
of these areas follows. 
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Advantaged Urban: Students in this group reside in metropolitan statisti- 
cal areas and attend schools where a high proportion of the students' parents 
are in professional or managerial positions. 

Disadvantaged Urban: Students in this group reside in metropolitan 
statistical areas and attend schools where a high proportion of the students' 
parents are on welfare or are not regularly employed. 

Extreme Rural: Students in this group do not reside in metropolitan 
statistical areas. They attend schools in areas with a population below 10,000 
where many of the students' parents are farmers or farm workers. 



Table A.l 



Tfcble AJ presents the percentages of students who participated in this school-based 
writing study in each of the major demographic categories. 
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•Due to rounding, percentages may not equal 100. 
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B: Students' Performance cm School-Based 
Writing and Their Use of Process Strategies 
and Resources for Writing 

The tabic in this appendix presents the percentages of students at each score level whose 
papers contained evidence of having employed process strategies and resources for 
writing. Process strategies include majoT revisions (changes beyond the sentence level), 
minor revisions (changes at the word or sentence level), and other strategies, such as 
conferencing with peers or teachers. Resources for writing include using one's own ideas, 
referring to something one has read, or referring to something one has studied 
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♦•Due to snail sample size* interpret with caution. 
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